2023-11-01T02:57:45.178 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-01T02:57:45.179 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457 --owner scheduled_benhanokh@teuthology --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/orig.config.yaml 2023-11-01T02:57:45.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-01T02:57:45.312 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457 branch: DBG_maintain_prefix_itr_2 description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false job_id: '7442457' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: DBG_maintain_prefix_itr_2 ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: DBG_maintain_prefix_itr_2 sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 owner: scheduled_benhanokh@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9009 sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: DBG_maintain_prefix_itr_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEny+pvqlar+v530FdjsCfFT6WNVxnjZiEVDNl9tHCurGg35izLFzLw88y+c+P3NZYCEgtxJxtZeOnQVxRzVlKI= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSe1wvYgaRTWfJC1wmfL/tBooUp9AYWKvs7s/AVlyEmGvFKrKtBLRkOlu6DZgxX95h8uMJ4T0yKOE+i2J8t/P8= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-10-31_16:51:39 tube: smithi user: benhanokh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-11-01T02:57:45.313 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa; will attempt to use it 2023-11-01T02:57:45.314 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks 2023-11-01T02:57:45.314 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-01T02:57:45.316 INFO:teuthology.task.internal:Checking packages... 2023-11-01T02:57:45.341 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '420cd129397301b1521ceb74e1bdbd9b855d2189' 2023-11-01T02:57:45.342 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-01T02:57:45.342 INFO:teuthology.packaging:ref: None 2023-11-01T02:57:45.343 INFO:teuthology.packaging:tag: None 2023-11-01T02:57:45.343 INFO:teuthology.packaging:branch: DBG_maintain_prefix_itr_2 2023-11-01T02:57:45.344 INFO:teuthology.packaging:sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T02:57:45.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=DBG_maintain_prefix_itr_2 2023-11-01T02:57:45.492 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6776.g420cd129 2023-11-01T02:57:45.493 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-01T02:57:45.500 INFO:teuthology.task.internal:no buildpackages task found 2023-11-01T02:57:45.500 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-01T02:57:45.526 INFO:teuthology.task.internal:Saving configuration 2023-11-01T02:57:45.551 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-01T02:57:45.557 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-01T02:57:45.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:52:27.195610', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEny+pvqlar+v530FdjsCfFT6WNVxnjZiEVDNl9tHCurGg35izLFzLw88y+c+P3NZYCEgtxJxtZeOnQVxRzVlKI='} 2023-11-01T02:57:45.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:52:27.193639', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSe1wvYgaRTWfJC1wmfL/tBooUp9AYWKvs7s/AVlyEmGvFKrKtBLRkOlu6DZgxX95h8uMJ4T0yKOE+i2J8t/P8='} 2023-11-01T02:57:45.607 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-01T02:57:45.614 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-11-01T02:57:45.614 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-01T02:57:45.614 INFO:teuthology.run_tasks:Running task console_log... 2023-11-01T02:57:45.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd77c04baf0>, signals=[15]) 2023-11-01T02:57:45.709 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-01T02:57:45.716 INFO:teuthology.task.internal:Opening connections... 2023-11-01T02:57:45.717 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T02:57:45.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T02:57:45.819 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T02:57:45.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T02:57:45.906 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-01T02:57:45.913 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-11-01T02:57:45.931 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-11-01T02:57:45.931 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-11-01T02:57:45.989 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-11-01T02:57:45.989 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2023-11-01T02:57:45.989 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-11-01T02:57:45.990 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-11-01T02:57:45.990 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2023-11-01T02:57:45.991 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2023-11-01T02:57:45.991 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-01T02:57:45.991 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-11-01T02:57:45.991 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2023-11-01T02:57:45.991 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-01T02:57:45.992 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-11-01T02:57:45.992 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-01T02:57:45.992 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-01T02:57:45.992 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-01T02:57:45.993 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-11-01T02:57:46.018 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-11-01T02:57:46.035 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-11-01T02:57:46.036 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-11-01T02:57:46.092 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-11-01T02:57:46.092 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2023-11-01T02:57:46.093 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-11-01T02:57:46.093 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-11-01T02:57:46.093 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2023-11-01T02:57:46.093 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2023-11-01T02:57:46.093 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-01T02:57:46.094 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-11-01T02:57:46.094 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2023-11-01T02:57:46.094 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-01T02:57:46.094 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-11-01T02:57:46.095 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-01T02:57:46.095 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-01T02:57:46.095 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-01T02:57:46.095 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-11-01T02:57:46.117 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-01T02:57:46.127 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-01T02:57:46.150 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-01T02:57:46.151 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-11-01T02:57:46.154 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-11-01T02:57:46.170 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-01T02:57:46.175 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-01T02:57:46.175 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-11-01T02:57:46.212 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-11-01T02:57:46.319 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-01T02:57:46.377 INFO:teuthology.run_tasks:Running task kernel... 2023-11-01T02:57:46.391 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-01T02:57:46.392 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-01T02:57:46.393 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-01T02:57:46.393 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-01T02:57:46.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:57:46.411 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-11-01T02:57:46.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T02:57:46.412 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-11-01T02:57:46.472 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-361.el9.x86_64 2023-11-01T02:57:46.472 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.14.0-361.el9.x86_64 2023-11-01T02:57:46.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2023-11-01T02:57:46.473 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-361.el9.x86_64 2023-11-01T02:57:46.474 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-361.el9.x86_64 2023-11-01T02:57:46.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2023-11-01T02:57:48.679 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-11-01T02:57:48.697 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 12 MB/s | 6.3 MB 00:00 2023-11-01T02:57:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-11-01T02:57:50.087 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-11-01T02:57:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-11-01T02:57:52.931 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-11-01T02:57:53.636 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 7.9 MB 00:03 2023-11-01T02:57:57.087 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 18 MB 00:02 2023-11-01T02:57:58.173 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.8 MB 00:01 2023-11-01T02:57:59.632 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2023-11-01T02:58:01.796 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.8 MB 00:01 2023-11-01T02:58:02.361 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 19 MB 00:02 2023-11-01T02:58:03.229 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2023-11-01T02:58:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 19 MB 00:01 2023-11-01T02:58:06.891 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-11-01T02:58:08.948 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-01T02:58:08.948 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-01T02:58:09.030 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T02:58:09.041 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T02:58:09.041 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-11-01T02:58:09.042 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T02:58:09.042 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T02:58:09.042 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-01T02:58:09.042 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T02:58:09.043 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-01T02:58:09.043 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-01T02:58:09.043 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-01T02:58:09.043 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:58:09.043 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T02:58:09.044 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T02:58:09.044 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2023-11-01T02:58:09.044 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:58:09.045 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 95 M 2023-11-01T02:58:09.045 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 120 M 2023-11-01T02:58:09.046 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T02:58:09.585 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 11 MB/s | 5.3 MB 00:00 2023-11-01T02:58:10.039 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-11-01T02:58:10.310 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 17 MB/s | 20 MB 00:01 2023-11-01T02:58:10.968 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 20 MB/s | 38 MB 00:01 2023-11-01T02:58:11.635 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 16 MB/s | 32 MB 00:02 2023-11-01T02:58:11.636 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T02:58:11.636 INFO:teuthology.orchestra.run.smithi153.stdout:Total 37 MB/s | 95 MB 00:02 2023-11-01T02:58:12.229 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-01T02:58:12.230 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-01T02:58:12.314 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T02:58:12.322 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T02:58:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-01T02:58:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-01T02:58:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-01T02:58:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:58:12.324 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T02:58:12.324 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T02:58:12.324 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2023-11-01T02:58:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:58:12.325 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 95 M 2023-11-01T02:58:12.325 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 120 M 2023-11-01T02:58:12.326 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T02:58:12.475 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T02:58:12.641 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 20 MB/s | 5.3 MB 00:00 2023-11-01T02:58:12.818 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T02:58:12.818 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T02:58:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-11-01T02:58:13.508 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 33 MB/s | 38 MB 00:01 2023-11-01T02:58:13.808 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 27 MB/s | 32 MB 00:01 2023-11-01T02:58:13.808 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T02:58:13.809 INFO:teuthology.orchestra.run.smithi005.stdout:Total 64 MB/s | 95 MB 00:01 2023-11-01T02:58:14.113 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T02:58:14.113 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T02:58:14.691 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T02:58:15.119 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T02:58:15.119 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T02:58:16.500 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T02:58:16.501 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T02:58:16.761 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T02:58:17.461 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-01T02:58:17.610 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:58:19.305 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T02:58:19.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-01T02:58:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:58:20.381 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:58:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:58:22.997 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:58:23.184 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:58:25.189 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:58:25.301 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:58:28.258 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:29.967 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:33.239 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:58.565 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:58.611 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:59.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-01T02:58:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:58:59.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:58:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:58:59.538 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:58:59.539 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T02:58:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-01T02:58:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-01T02:58:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-01T02:58:59.539 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-01T02:58:59.540 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:58:59.540 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T02:59:00.030 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-11-01T02:59:00.165 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-01T02:59:00.165 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-01T02:59:00.166 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-01T02:59:00.166 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-01T02:59:00.166 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-01T02:59:00.166 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-01T02:59:00.167 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2023-11-01T02:59:00.167 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-11-01T02:59:00.284 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-01T02:59:00.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-01T02:59:00.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2023-11-01T02:59:00.318 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2023-11-01T02:59:00.319 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2023-11-01T02:59:00.319 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2023-11-01T02:59:00.319 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 68.el9 2023-11-01T02:59:00.319 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2023-11-01T02:59:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-01T02:59:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2023-11-01T02:59:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8264254 2023-11-01T02:59:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2023-11-01T02:59:00.320 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-01T02:59:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-01T02:59:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-01T02:59:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-01T02:59:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2023-11-01T02:59:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2023-11-01T02:59:00.322 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-01T02:59:00.322 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2023-11-01T02:59:00.322 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2023-11-01T02:59:00.322 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:59:00.322 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-01T02:59:00.323 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-01T02:59:00.323 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-01T02:59:00.323 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2023-11-01T02:59:00.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T02:59:00.323 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2023-11-01T02:59:00.324 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-01T02:59:00.325 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 5.14.0-378.el9.x86_64 2023-11-01T02:59:00.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-01T02:59:00.951 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-11-01T02:59:02.420 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-01T02:59:02.450 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-11-01T02:59:02.452 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-11-01T02:59:02.469 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.uIpkTNfZ2h 2023-11-01T02:59:02.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uIpkTNfZ2h 2023-11-01T02:59:02.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.uIpkTNfZ2h 2023-11-01T02:59:02.676 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.uIpkTNfZ2h is 6KB 2023-11-01T02:59:02.725 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.uIpkTNfZ2h 2023-11-01T02:59:02.740 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2023-11-01T02:59:02.805 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-01T02:59:02.805 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-01T02:59:02.805 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-01T02:59:02.806 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-01T02:59:02.807 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-01T02:59:02.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2023-11-01T02:59:03.984 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:59:04.030 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:59:04.426 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:59:04.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-01T02:59:04.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-01T02:59:04.427 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-01T02:59:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-01T02:59:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:59:04.844 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T02:59:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-01T02:59:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-01T02:59:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-01T02:59:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-01T02:59:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:59:04.846 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T02:59:05.350 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2023-11-01T02:59:05.501 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-01T02:59:05.502 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-01T02:59:05.502 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-01T02:59:05.502 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-01T02:59:05.503 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-01T02:59:05.503 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-01T02:59:05.503 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2023-11-01T02:59:05.503 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2023-11-01T02:59:05.625 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-01T02:59:05.626 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-01T02:59:05.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2023-11-01T02:59:05.673 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2023-11-01T02:59:05.673 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2023-11-01T02:59:05.674 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2023-11-01T02:59:05.674 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 68.el9 2023-11-01T02:59:05.674 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2023-11-01T02:59:05.674 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-01T02:59:05.674 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2023-11-01T02:59:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8264254 2023-11-01T02:59:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2023-11-01T02:59:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-01T02:59:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-01T02:59:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-01T02:59:05.676 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-01T02:59:05.676 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2023-11-01T02:59:05.676 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2023-11-01T02:59:05.676 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-01T02:59:05.676 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2023-11-01T02:59:05.677 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2023-11-01T02:59:05.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:59:05.677 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-01T02:59:05.677 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-01T02:59:05.677 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-01T02:59:05.678 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2023-11-01T02:59:05.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T02:59:05.678 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2023-11-01T02:59:05.679 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-01T02:59:05.679 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-378.el9.x86_64 2023-11-01T02:59:05.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-01T02:59:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-11-01T02:59:07.677 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-01T02:59:07.705 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-11-01T02:59:07.707 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2023-11-01T02:59:07.723 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.ySDAqmgbNQ 2023-11-01T02:59:07.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ySDAqmgbNQ 2023-11-01T02:59:07.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.ySDAqmgbNQ 2023-11-01T02:59:07.939 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.ySDAqmgbNQ is 6KB 2023-11-01T02:59:07.987 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.ySDAqmgbNQ 2023-11-01T02:59:08.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2023-11-01T02:59:08.070 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-01T02:59:08.070 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-01T02:59:08.071 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-01T02:59:08.071 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-01T02:59:08.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-01T02:59:08.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2023-11-01T02:59:33.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-01T02:59:33.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T02:59:33.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T02:59:38.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-01T02:59:38.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T02:59:38.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T02:59:51.547 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-01T02:59:56.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-01T03:00:00.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:00:00.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:00:03.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-01T03:00:05.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T03:00:05.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:00:15.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:00:15.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:00:34.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-01T03:00:49.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:00:49.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:00:49.500 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-11-01T03:00:49.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:00:49.999 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-01T03:00:49.999 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-11-01T03:00:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-378.el9.x86_64 2023-11-01T03:00:50.015 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-01T03:00:50.015 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-01T03:00:50.015 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-01T03:00:51.016 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-01T03:00:51.017 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-01T03:00:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2023-11-01T03:00:51.125 DEBUG:teuthology.parallel:result is None 2023-11-01T03:01:05.677 DEBUG:teuthology.orchestra.remote:timed out 2023-11-01T03:01:17.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T03:01:17.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:01:18.058 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-11-01T03:01:18.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T03:01:18.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-01T03:01:18.424 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-11-01T03:01:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-378.el9.x86_64 2023-11-01T03:01:18.440 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-01T03:01:18.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-01T03:01:18.441 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-01T03:01:19.441 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-01T03:01:19.442 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-01T03:01:19.540 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2023-11-01T03:01:19.567 DEBUG:teuthology.parallel:result is None 2023-11-01T03:01:19.568 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-01T03:01:19.576 INFO:teuthology.task.internal:Creating test directory... 2023-11-01T03:01:19.576 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-01T03:01:19.578 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-01T03:01:19.599 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-01T03:01:19.607 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-01T03:01:19.642 INFO:teuthology.task.internal:Creating archive directory... 2023-11-01T03:01:19.643 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-01T03:01:19.645 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-01T03:01:19.780 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-01T03:01:19.787 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-01T03:01:19.788 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-01T03:01:19.790 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-01T03:01:19.830 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-01T03:01:19.848 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-01T03:01:19.848 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-01T03:01:19.862 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-01T03:01:19.864 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-01T03:01:19.871 INFO:teuthology.task.internal:Configuring sudo... 2023-11-01T03:01:19.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-01T03:01:19.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-01T03:01:19.923 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-01T03:01:19.933 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-01T03:01:19.933 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-01T03:01:19.966 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-01T03:01:19.982 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-01T03:01:20.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-01T03:01:20.116 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-01T03:01:20.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-01T03:01:20.245 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:01:20.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-01T03:01:20.315 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-01T03:01:20.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-01T03:01:20.419 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-01T03:01:20.506 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-01T03:01:20.549 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:01:20.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-01T03:01:20.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-11-01T03:01:20.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-11-01T03:01:20.669 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T03:01:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T03:01:21.133 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-01T03:01:21.141 INFO:teuthology.task.internal:Starting timer... 2023-11-01T03:01:21.142 INFO:teuthology.run_tasks:Running task pcp... 2023-11-01T03:01:21.204 INFO:teuthology.run_tasks:Running task selinux... 2023-11-01T03:01:21.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-11-01T03:01:21.290 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-11-01T03:01:21.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-11-01T03:01:21.366 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-11-01T03:01:21.369 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-01T03:01:21.369 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-11-01T03:01:21.394 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-11-01T03:01:21.395 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-11-01T03:01:21.415 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-11-01T03:01:21.415 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2023-11-01T03:01:21.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T03:01:21.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:01:21.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T03:01:21.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:01:21.498 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-01T03:01:21.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-11-01T03:01:21.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-11-01T03:01:21.584 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-01T03:01:21.594 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-01T03:01:21.600 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-01T03:01:21.759 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-01T03:01:21.776 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-01T03:01:21.777 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-01T03:06:45.587 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-11-01T03:06:45.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T03:06:45.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:06:45.687 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-11-01T03:06:45.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-01T03:06:45.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:06:45.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-01T03:06:45.844 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-11-01T03:06:45.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-01T03:06:45.915 INFO:teuthology.run_tasks:Running task clock... 2023-11-01T03:06:45.927 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-01T03:06:45.927 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-01T03:06:45.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T03:06:45.930 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-01T03:06:45.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T03:06:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-01T03:06:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-01T03:06:45.987 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-01T03:06:46.003 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-11-01T03:06:46.033 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-11-01T03:06:46.036 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-11-01T03:06:46.046 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-11-01T03:06:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-01T03:06:46.063 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-01T03:06:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-01T03:06:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-01T03:06:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2023-11-01T03:06:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2023-11-01T03:06:46.125 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T03:06:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-11-01T03:06:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.127 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T03:06:46.127 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-11-01T03:06:46.128 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.128 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.128 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.128 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:06:46.129 INFO:teuthology.run_tasks:Running task install... 2023-11-01T03:06:46.144 DEBUG:teuthology.task.install:project ceph 2023-11-01T03:06:46.144 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}} 2023-11-01T03:06:46.145 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'} 2023-11-01T03:06:46.145 INFO:teuthology.task.install:Using flavor: default 2023-11-01T03:06:46.150 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-11-01T03:06:46.151 INFO:teuthology.task.install:extra packages: [] 2023-11-01T03:06:46.151 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'tag': None, 'wait_for_package': False} 2023-11-01T03:06:46.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:06:46.154 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'tag': None, 'wait_for_package': False} 2023-11-01T03:06:46.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:06:46.331 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/ 2023-11-01T03:06:46.332 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6776.g420cd129 2023-11-01T03:06:46.342 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/ 2023-11-01T03:06:46.343 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6776.g420cd129 2023-11-01T03:06:46.438 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-01T03:06:46.438 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:06:46.439 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-01T03:06:46.455 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-01T03:06:46.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:06:46.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-01T03:06:46.467 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-11-01T03:06:46.467 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/420cd129397301b1521ceb74e1bdbd9b855d2189/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-01T03:06:46.487 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-11-01T03:06:46.488 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/420cd129397301b1521ceb74e1bdbd9b855d2189/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-01T03:06:46.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-01T03:06:46.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-01T03:06:46.614 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-01T03:06:46.648 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-01T03:06:46.678 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-11-01T03:06:46.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-11-01T03:06:46.680 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-11-01T03:06:46.682 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-11-01T03:06:46.920 INFO:teuthology.orchestra.run.smithi153.stdout:72 files removed 2023-11-01T03:06:46.925 INFO:teuthology.orchestra.run.smithi005.stdout:72 files removed 2023-11-01T03:06:46.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw 2023-11-01T03:06:46.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw 2023-11-01T03:06:47.590 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 238 kB/s | 78 kB 00:00 2023-11-01T03:06:47.615 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 238 kB/s | 78 kB 00:00 2023-11-01T03:06:47.949 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-11-01T03:06:47.957 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-11-01T03:06:48.307 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-11-01T03:06:48.316 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2023-11-01T03:06:48.702 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-01T03:06:48.718 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-11-01T03:06:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2023-11-01T03:06:50.069 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.0 MB 00:00 2023-11-01T03:06:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 7.9 MB 00:00 2023-11-01T03:06:51.884 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 7.9 MB 00:01 2023-11-01T03:06:53.786 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-01T03:06:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 5.8 MB 00:01 2023-11-01T03:06:59.912 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-11-01T03:07:01.364 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 14 MB/s | 19 MB 00:01 2023-11-01T03:07:02.476 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 18 MB 00:10 2023-11-01T03:07:06.147 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2023-11-01T03:07:06.602 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 5.8 MB 00:00 2023-11-01T03:07:07.870 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 15 kB 00:00 2023-11-01T03:07:08.596 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:07:08.611 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:08.611 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:07:08.611 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:08.611 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:07:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 8.6 M 2023-11-01T03:07:08.612 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-11-01T03:07:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.3 M 2023-11-01T03:07:08.612 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-01T03:07:08.612 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:07:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options 2023-11-01T03:07:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-01T03:07:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.2 M 2023-11-01T03:07:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-01T03:07:08.613 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-6776.g420cd129.el9 ceph 24 k 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 715 k 2023-11-01T03:07:08.614 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-01T03:07:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-01T03:07:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-01T03:07:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 472 k 2023-11-01T03:07:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-01T03:07:08.615 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.8 M 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: x86_64 2:18.0.0-6776.g420cd129.el9 ceph 45 k 2023-11-01T03:07:08.616 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 127 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-6776.g420cd129.el9 ceph 161 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-6776.g420cd129.el9 ceph 321 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 298 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 99 k 2023-11-01T03:07:08.617 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-01T03:07:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-01T03:07:08.618 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:08.618 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:07:08.618 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:08.618 INFO:teuthology.orchestra.run.smithi005.stdout:Install 28 Packages 2023-11-01T03:07:08.619 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2023-11-01T03:07:08.619 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:08.619 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 55 M 2023-11-01T03:07:08.619 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:07:11.673 INFO:teuthology.orchestra.run.smithi005.stdout:(1/30): ceph-base-18.0.0-6776.g420cd129.el9.x86 1.9 MB/s | 5.2 MB 00:02 2023-11-01T03:07:11.723 INFO:teuthology.orchestra.run.smithi005.stdout:(2/30): ceph-selinux-18.0.0-6776.g420cd129.el9. 485 kB/s | 24 kB 00:00 2023-11-01T03:07:11.923 INFO:teuthology.orchestra.run.smithi005.stdout:(3/30): libcephfs2-18.0.0-6776.g420cd129.el9.x8 3.5 MB/s | 715 kB 00:00 2023-11-01T03:07:12.040 INFO:teuthology.orchestra.run.smithi005.stdout:(4/30): libradosstriper1-18.0.0-6776.g420cd129. 3.9 MB/s | 472 kB 00:00 2023-11-01T03:07:12.366 INFO:teuthology.orchestra.run.smithi005.stdout:(5/30): ceph-common-18.0.0-6776.g420cd129.el9.x 5.6 MB/s | 19 MB 00:03 2023-11-01T03:07:12.458 INFO:teuthology.orchestra.run.smithi005.stdout:(6/30): ceph-radosgw-18.0.0-6776.g420cd129.el9. 2.5 MB/s | 8.6 MB 00:03 2023-11-01T03:07:12.483 INFO:teuthology.orchestra.run.smithi005.stdout:(7/30): python3-ceph-argparse-18.0.0-6776.g420c 387 kB/s | 45 kB 00:00 2023-11-01T03:07:12.508 INFO:teuthology.orchestra.run.smithi005.stdout:(8/30): python3-ceph-common-18.0.0-6776.g420cd1 2.5 MB/s | 127 kB 00:00 2023-11-01T03:07:12.533 INFO:teuthology.orchestra.run.smithi005.stdout:(9/30): python3-cephfs-18.0.0-6776.g420cd129.el 3.2 MB/s | 161 kB 00:00 2023-11-01T03:07:12.584 INFO:teuthology.orchestra.run.smithi005.stdout:(10/30): python3-rbd-18.0.0-6776.g420cd129.el9. 5.8 MB/s | 298 kB 00:00 2023-11-01T03:07:12.609 INFO:teuthology.orchestra.run.smithi005.stdout:(11/30): python3-rados-18.0.0-6776.g420cd129.el 3.1 MB/s | 321 kB 00:00 2023-11-01T03:07:12.634 INFO:teuthology.orchestra.run.smithi005.stdout:(12/30): python3-rgw-18.0.0-6776.g420cd129.el9. 1.9 MB/s | 99 kB 00:00 2023-11-01T03:07:12.751 INFO:teuthology.orchestra.run.smithi005.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 746 kB/s | 106 kB 00:00 2023-11-01T03:07:12.776 INFO:teuthology.orchestra.run.smithi005.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2023-11-01T03:07:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2023-11-01T03:07:12.844 INFO:teuthology.orchestra.run.smithi005.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-11-01T03:07:12.869 INFO:teuthology.orchestra.run.smithi005.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 827 kB/s | 41 kB 00:00 2023-11-01T03:07:12.986 INFO:teuthology.orchestra.run.smithi005.stdout:(18/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2023-11-01T03:07:13.086 INFO:teuthology.orchestra.run.smithi005.stdout:(19/30): librgw2-18.0.0-6776.g420cd129.el9.x86_ 4.6 MB/s | 4.8 MB 00:01 2023-11-01T03:07:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 187 kB/s | 111 kB 00:00 2023-11-01T03:07:13.670 INFO:teuthology.orchestra.run.smithi005.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 117 kB/s | 24 kB 00:00 2023-11-01T03:07:13.787 INFO:teuthology.orchestra.run.smithi005.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2023-11-01T03:07:13.845 INFO:teuthology.orchestra.run.smithi005.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 359 kB/s | 309 kB 00:00 2023-11-01T03:07:13.996 INFO:teuthology.orchestra.run.smithi005.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 323 kB/s | 67 kB 00:00 2023-11-01T03:07:14.379 INFO:teuthology.orchestra.run.smithi005.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 500 kB/s | 192 kB 00:00 2023-11-01T03:07:14.963 INFO:teuthology.orchestra.run.smithi005.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 750 kB/s | 837 kB 00:01 2023-11-01T03:07:15.588 INFO:teuthology.orchestra.run.smithi005.stdout:(27/30): librados2-18.0.0-6776.g420cd129.el9.x8 5.3 MB/s | 3.3 MB 00:00 2023-11-01T03:07:16.063 INFO:teuthology.orchestra.run.smithi005.stdout:(28/30): librbd1-18.0.0-6776.g420cd129.el9.x86_ 6.4 MB/s | 3.0 MB 00:00 2023-11-01T03:07:16.463 INFO:teuthology.orchestra.run.smithi005.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 777 kB/s | 1.6 MB 00:02 2023-11-01T03:07:18.605 INFO:teuthology.orchestra.run.smithi005.stdout:(30/30): libarrow-9.0.0-9.el9.x86_64.rpm 820 kB/s | 4.4 MB 00:05 2023-11-01T03:07:18.609 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:07:18.609 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.5 MB/s | 55 MB 00:09 2023-11-01T03:07:18.621 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:07:18.664 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:07:18.664 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:07:19.159 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:07:19.160 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:07:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:07:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-01T03:07:20.861 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 19 MB 00:12 2023-11-01T03:07:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-01T03:07:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-01T03:07:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-01T03:07:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 6/32 2023-11-01T03:07:21.544 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:21.590 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:21.623 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-01T03:07:21.667 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 9/32 2023-11-01T03:07:21.742 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-01T03:07:21.768 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-01T03:07:21.817 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-01T03:07:21.926 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-01T03:07:21.967 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-01T03:07:22.018 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-01T03:07:22.048 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-01T03:07:22.076 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-01T03:07:22.111 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-01T03:07:22.144 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-01T03:07:22.462 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-01T03:07:22.499 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-01T03:07:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-01T03:07:22.620 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 21/32 2023-11-01T03:07:22.656 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-01T03:07:23.106 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-01T03:07:23.143 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-01T03:07:23.207 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-01T03:07:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 25/32 2023-11-01T03:07:23.304 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 26/32 2023-11-01T03:07:25.443 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:25.485 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:25.511 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 8.0 kB/s | 1.7 kB 00:00 2023-11-01T03:07:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-01T03:07:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-01T03:07:26.182 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-01T03:07:26.182 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-01T03:07:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:27.880 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:07:27.891 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:27.891 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:07:27.891 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:27.892 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:07:27.892 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 8.6 M 2023-11-01T03:07:27.892 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-11-01T03:07:27.892 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.3 M 2023-11-01T03:07:27.892 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-01T03:07:27.893 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:07:27.893 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options 2023-11-01T03:07:27.893 INFO:teuthology.orchestra.run.smithi153.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-01T03:07:27.893 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.2 M 2023-11-01T03:07:27.893 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.0.0-6776.g420cd129.el9 ceph 24 k 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-01T03:07:27.894 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 715 k 2023-11-01T03:07:27.895 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-01T03:07:27.895 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-01T03:07:27.895 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-01T03:07:27.895 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 472 k 2023-11-01T03:07:27.895 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.8 M 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse 2023-11-01T03:07:27.896 INFO:teuthology.orchestra.run.smithi153.stdout: x86_64 2:18.0.0-6776.g420cd129.el9 ceph 45 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 127 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.0.0-6776.g420cd129.el9 ceph 161 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.0.0-6776.g420cd129.el9 ceph 321 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 298 k 2023-11-01T03:07:27.897 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 99 k 2023-11-01T03:07:27.898 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-01T03:07:27.898 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-01T03:07:27.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:27.898 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:07:27.898 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:27.899 INFO:teuthology.orchestra.run.smithi153.stdout:Install 28 Packages 2023-11-01T03:07:27.899 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2023-11-01T03:07:27.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:27.899 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 55 M 2023-11-01T03:07:27.900 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:07:28.787 INFO:teuthology.orchestra.run.smithi153.stdout:(1/30): ceph-base-18.0.0-6776.g420cd129.el9.x86 6.7 MB/s | 5.2 MB 00:00 2023-11-01T03:07:28.846 INFO:teuthology.orchestra.run.smithi153.stdout:(2/30): ceph-selinux-18.0.0-6776.g420cd129.el9. 413 kB/s | 24 kB 00:00 2023-11-01T03:07:28.955 INFO:teuthology.orchestra.run.smithi153.stdout:(3/30): libcephfs2-18.0.0-6776.g420cd129.el9.x8 6.5 MB/s | 715 kB 00:00 2023-11-01T03:07:29.063 INFO:teuthology.orchestra.run.smithi153.stdout:(4/30): libradosstriper1-18.0.0-6776.g420cd129. 4.3 MB/s | 472 kB 00:00 2023-11-01T03:07:29.172 INFO:teuthology.orchestra.run.smithi153.stdout:(5/30): ceph-radosgw-18.0.0-6776.g420cd129.el9. 7.4 MB/s | 8.6 MB 00:01 2023-11-01T03:07:29.247 INFO:teuthology.orchestra.run.smithi153.stdout:(6/30): python3-ceph-argparse-18.0.0-6776.g420c 602 kB/s | 45 kB 00:00 2023-11-01T03:07:29.323 INFO:teuthology.orchestra.run.smithi153.stdout:(7/30): python3-ceph-common-18.0.0-6776.g420cd1 1.7 MB/s | 127 kB 00:00 2023-11-01T03:07:29.398 INFO:teuthology.orchestra.run.smithi153.stdout:(8/30): python3-cephfs-18.0.0-6776.g420cd129.el 2.1 MB/s | 161 kB 00:00 2023-11-01T03:07:29.473 INFO:teuthology.orchestra.run.smithi153.stdout:(9/30): python3-rados-18.0.0-6776.g420cd129.el9 4.2 MB/s | 321 kB 00:00 2023-11-01T03:07:29.573 INFO:teuthology.orchestra.run.smithi153.stdout:(10/30): librgw2-18.0.0-6776.g420cd129.el9.x86_ 9.4 MB/s | 4.8 MB 00:00 2023-11-01T03:07:29.599 INFO:teuthology.orchestra.run.smithi153.stdout:(11/30): python3-rbd-18.0.0-6776.g420cd129.el9. 2.3 MB/s | 298 kB 00:00 2023-11-01T03:07:29.641 INFO:teuthology.orchestra.run.smithi153.stdout:(12/30): python3-rgw-18.0.0-6776.g420cd129.el9. 1.4 MB/s | 99 kB 00:00 2023-11-01T03:07:29.749 INFO:teuthology.orchestra.run.smithi153.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 704 kB/s | 106 kB 00:00 2023-11-01T03:07:29.775 INFO:teuthology.orchestra.run.smithi153.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2023-11-01T03:07:29.808 INFO:teuthology.orchestra.run.smithi153.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-01T03:07:29.842 INFO:teuthology.orchestra.run.smithi153.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2023-11-01T03:07:29.867 INFO:teuthology.orchestra.run.smithi153.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 706 kB/s | 41 kB 00:00 2023-11-01T03:07:30.051 INFO:teuthology.orchestra.run.smithi153.stdout:(18/30): ceph-common-18.0.0-6776.g420cd129.el9. 9.3 MB/s | 19 MB 00:02 2023-11-01T03:07:30.166 INFO:teuthology.orchestra.run.smithi153.stdout:(19/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 140 kB/s | 45 kB 00:00 2023-11-01T03:07:30.274 INFO:teuthology.orchestra.run.smithi153.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 272 kB/s | 111 kB 00:00 2023-11-01T03:07:30.308 INFO:teuthology.orchestra.run.smithi153.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2023-11-01T03:07:30.342 INFO:teuthology.orchestra.run.smithi153.stdout:(22/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 361 kB/s | 24 kB 00:00 2023-11-01T03:07:30.367 INFO:teuthology.orchestra.run.smithi153.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 825 kB/s | 49 kB 00:00 2023-11-01T03:07:30.418 INFO:teuthology.orchestra.run.smithi153.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 893 kB/s | 67 kB 00:00 2023-11-01T03:07:30.510 INFO:teuthology.orchestra.run.smithi153.stdout:(25/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.8 MB/s | 837 kB 00:00 2023-11-01T03:07:30.544 INFO:teuthology.orchestra.run.smithi153.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-11-01T03:07:30.644 INFO:teuthology.orchestra.run.smithi153.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2023-11-01T03:07:30.711 INFO:teuthology.orchestra.run.smithi153.stdout:(28/30): libarrow-9.0.0-9.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2023-11-01T03:07:30.953 INFO:teuthology.orchestra.run.smithi153.stdout:(29/30): librados2-18.0.0-6776.g420cd129.el9.x8 8.1 MB/s | 3.3 MB 00:00 2023-11-01T03:07:31.003 INFO:teuthology.orchestra.run.smithi153.stdout:(30/30): librbd1-18.0.0-6776.g420cd129.el9.x86_ 8.4 MB/s | 3.0 MB 00:00 2023-11-01T03:07:31.006 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:07:31.007 INFO:teuthology.orchestra.run.smithi153.stdout:Total 18 MB/s | 55 MB 00:03 2023-11-01T03:07:31.018 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:07:31.057 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:07:31.057 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:07:31.546 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:07:31.547 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:07:32.926 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:07:32.990 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-01T03:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-01T03:07:33.100 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-01T03:07:33.416 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-01T03:07:33.473 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:33.548 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:33.641 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 6/32 2023-11-01T03:07:33.675 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:33.720 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:33.749 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-01T03:07:33.793 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 9/32 2023-11-01T03:07:33.868 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-01T03:07:33.894 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-01T03:07:33.943 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-01T03:07:34.049 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-01T03:07:34.085 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-01T03:07:34.134 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-01T03:07:34.166 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-01T03:07:34.195 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-01T03:07:34.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-01T03:07:34.264 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-01T03:07:34.567 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-01T03:07:34.594 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-01T03:07:34.668 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-01T03:07:34.699 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 21/32 2023-11-01T03:07:34.735 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-01T03:07:35.162 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-01T03:07:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-01T03:07:35.259 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-01T03:07:35.335 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 25/32 2023-11-01T03:07:35.374 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 26/32 2023-11-01T03:07:36.073 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:36.073 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-11-01T03:07:36.073 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-11-01T03:07:36.073 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-11-01T03:07:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-11-01T03:07:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-11-01T03:07:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2023-11-01T03:07:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-11-01T03:07:36.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:36.922 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-01T03:07:36.950 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-01T03:07:36.951 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:07:36.951 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-01T03:07:36.951 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-01T03:07:36.951 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-01T03:07:36.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:36.953 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-01T03:07:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-01T03:07:37.050 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:37.510 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:37.547 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-01T03:07:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 1/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 3/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 4/32 2023-11-01T03:07:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 6/32 2023-11-01T03:07:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 8/32 2023-11-01T03:07:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 9/32 2023-11-01T03:07:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-01T03:07:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 11/32 2023-11-01T03:07:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 12/32 2023-11-01T03:07:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 13/32 2023-11-01T03:07:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-01T03:07:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-01T03:07:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-01T03:07:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-01T03:07:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-01T03:07:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-01T03:07:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-01T03:07:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-01T03:07:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-01T03:07:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-01T03:07:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-01T03:07:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 31/32 2023-11-01T03:07:38.220 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-01T03:07:38.220 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-01T03:07:38.220 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-01T03:07:38.221 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:38.251 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:39.159 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-11-01T03:07:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.159 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-01T03:07:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-01T03:07:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-01T03:07:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-01T03:07:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-01T03:07:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-3.el9.x86_64 2023-11-01T03:07:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-01T03:07:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:39.165 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:07:39.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test 2023-11-01T03:07:40.052 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:34 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:07:40.203 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:07:40.204 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:07:40.204 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:40.205 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:07:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-6776.g420cd129.el9 ceph 41 M 2023-11-01T03:07:40.205 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:07:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-01T03:07:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-6776.g420cd129.el9 ceph 164 k 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:07:40.206 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:07:40.207 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2023-11-01T03:07:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:40.207 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 42 M 2023-11-01T03:07:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 173 M 2023-11-01T03:07:40.208 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:07:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.5 MB/s | 217 kB 00:00 2023-11-01T03:07:40.824 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-11-01T03:07:40.857 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-01T03:07:40.949 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): libcephsqlite-18.0.0-6776.g420cd129.el9. 532 kB/s | 164 kB 00:00 2023-11-01T03:07:41.074 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): jq-1.6-15.el9.x86_64.rpm 862 kB/s | 187 kB 00:00 2023-11-01T03:07:42.749 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): ceph-test-18.0.0-6776.g420cd129.el9.x86_ 20 MB/s | 41 MB 00:02 2023-11-01T03:07:42.752 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:07:42.753 INFO:teuthology.orchestra.run.smithi005.stdout:Total 17 MB/s | 42 MB 00:02 2023-11-01T03:07:42.767 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:07:42.790 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:07:42.791 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:07:43.155 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:07:43.156 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:07:43.716 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:07:43.785 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-01T03:07:43.817 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-01T03:07:43.849 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-01T03:07:43.896 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-01T03:07:43.919 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-01T03:07:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:47.718 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-11-01T03:07:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-11-01T03:07:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-11-01T03:07:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-11-01T03:07:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-11-01T03:07:47.719 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2023-11-01T03:07:47.720 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-11-01T03:07:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:48.006 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-01T03:07:48.079 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-01T03:07:48.551 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-01T03:07:48.581 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-01T03:07:48.582 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:07:48.582 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-01T03:07:48.582 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-01T03:07:48.582 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-01T03:07:48.583 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:48.584 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-01T03:07:48.678 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-01T03:07:48.678 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:49.836 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:49.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 1/32 2023-11-01T03:07:49.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2/32 2023-11-01T03:07:49.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 3/32 2023-11-01T03:07:49.837 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 4/32 2023-11-01T03:07:49.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-01T03:07:49.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 6/32 2023-11-01T03:07:49.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-01T03:07:49.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 8/32 2023-11-01T03:07:49.838 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 9/32 2023-11-01T03:07:49.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-01T03:07:49.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 11/32 2023-11-01T03:07:49.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 12/32 2023-11-01T03:07:49.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 13/32 2023-11-01T03:07:49.839 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-01T03:07:49.840 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-01T03:07:49.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-01T03:07:49.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-01T03:07:49.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-01T03:07:49.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-01T03:07:49.841 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-01T03:07:49.842 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 31/32 2023-11-01T03:07:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-01T03:07:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 1/6 2023-11-01T03:07:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2/6 2023-11-01T03:07:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-01T03:07:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-01T03:07:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-01T03:07:50.618 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-01T03:07:50.618 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:50.618 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:07:50.618 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-15.el9.x86_64 2023-11-01T03:07:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-01T03:07:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-01T03:07:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-01T03:07:50.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:50.620 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:07:50.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph 2023-11-01T03:07:50.975 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-01T03:07:50.975 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-11-01T03:07:50.976 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.976 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:07:50.976 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-01T03:07:50.977 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.977 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.977 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.977 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.977 INFO:teuthology.orchestra.run.smithi153.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-01T03:07:50.978 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-01T03:07:50.978 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-01T03:07:50.978 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-01T03:07:50.978 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-01T03:07:50.979 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.980 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.981 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-01T03:07:50.981 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.981 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.981 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:07:50.981 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2023-11-01T03:07:50.982 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-01T03:07:50.982 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:07:51.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test 2023-11-01T03:07:51.488 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:45 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:07:51.636 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:07:51.639 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================= 2023-11-01T03:07:51.639 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:07:51.639 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================= 2023-11-01T03:07:51.639 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:07:51.639 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-6776.g420cd129.el9 ceph 6.5 k 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-6776.g420cd129.el9 ceph 2.1 M 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.5 M 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 243 k 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.4 M 2023-11-01T03:07:51.640 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 18 M 2023-11-01T03:07:51.641 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-01T03:07:51.641 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-01T03:07:51.641 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-01T03:07:51.641 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-01T03:07:51.641 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-01T03:07:51.642 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-01T03:07:51.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-01T03:07:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-01T03:07:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-01T03:07:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-01T03:07:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-01T03:07:51.644 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-01T03:07:51.645 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-01T03:07:51.645 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-01T03:07:51.645 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-01T03:07:51.645 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-01T03:07:51.645 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-01T03:07:51.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:51.646 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:07:51.646 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================= 2023-11-01T03:07:51.646 INFO:teuthology.orchestra.run.smithi005.stdout:Install 33 Packages 2023-11-01T03:07:51.646 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:51.647 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 30 M 2023-11-01T03:07:51.647 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 110 M 2023-11-01T03:07:51.647 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:07:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:26 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:07:52.038 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:07:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:52.039 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:07:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.0.0-6776.g420cd129.el9 ceph 41 M 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.0.0-6776.g420cd129.el9 ceph 164 k 2023-11-01T03:07:52.040 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-01T03:07:52.041 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-01T03:07:52.041 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-01T03:07:52.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:07:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:07:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2023-11-01T03:07:52.042 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:07:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 42 M 2023-11-01T03:07:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 173 M 2023-11-01T03:07:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:07:52.052 INFO:teuthology.orchestra.run.smithi005.stdout:(1/33): ceph-18.0.0-6776.g420cd129.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2023-11-01T03:07:52.394 INFO:teuthology.orchestra.run.smithi005.stdout:(2/33): ceph-mds-18.0.0-6776.g420cd129.el9.x86_ 4.0 MB/s | 2.1 MB 00:00 2023-11-01T03:07:52.436 INFO:teuthology.orchestra.run.smithi005.stdout:(3/33): ceph-mgr-18.0.0-6776.g420cd129.el9.x86_ 2.6 MB/s | 1.5 MB 00:00 2023-11-01T03:07:52.482 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2023-11-01T03:07:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:(4/33): ceph-mon-18.0.0-6776.g420cd129.el9.x86_ 9.7 MB/s | 4.4 MB 00:00 2023-11-01T03:07:52.528 INFO:teuthology.orchestra.run.smithi005.stdout:(5/33): ceph-mgr-modules-core-18.0.0-6776.g420c 2.6 MB/s | 243 kB 00:00 2023-11-01T03:07:52.531 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2023-11-01T03:07:52.565 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-01T03:07:52.629 INFO:teuthology.orchestra.run.smithi005.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 418 kB/s | 32 kB 00:00 2023-11-01T03:07:52.654 INFO:teuthology.orchestra.run.smithi005.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 959 kB/s | 144 kB 00:00 2023-11-01T03:07:52.671 INFO:teuthology.orchestra.run.smithi005.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 921 kB/s | 39 kB 00:00 2023-11-01T03:07:52.691 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): jq-1.6-15.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-11-01T03:07:52.696 INFO:teuthology.orchestra.run.smithi005.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-11-01T03:07:52.721 INFO:teuthology.orchestra.run.smithi005.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-11-01T03:07:52.741 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): libcephsqlite-18.0.0-6776.g420cd129.el9. 376 kB/s | 164 kB 00:00 2023-11-01T03:07:52.747 INFO:teuthology.orchestra.run.smithi005.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-11-01T03:07:52.772 INFO:teuthology.orchestra.run.smithi005.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2023-11-01T03:07:52.797 INFO:teuthology.orchestra.run.smithi005.stdout:(13/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2023-11-01T03:07:53.139 INFO:teuthology.orchestra.run.smithi005.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2023-11-01T03:07:53.315 INFO:teuthology.orchestra.run.smithi005.stdout:(15/33): ceph-osd-18.0.0-6776.g420cd129.el9.x86 19 MB/s | 18 MB 00:00 2023-11-01T03:07:53.540 INFO:teuthology.orchestra.run.smithi005.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 108 kB/s | 43 kB 00:00 2023-11-01T03:07:53.657 INFO:teuthology.orchestra.run.smithi005.stdout:(17/33): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.2 MB 00:00 2023-11-01T03:07:53.682 INFO:teuthology.orchestra.run.smithi005.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 503 kB/s | 172 kB 00:00 2023-11-01T03:07:53.707 INFO:teuthology.orchestra.run.smithi005.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2023-11-01T03:07:53.766 INFO:teuthology.orchestra.run.smithi005.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2023-11-01T03:07:53.783 INFO:teuthology.orchestra.run.smithi005.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2023-11-01T03:07:53.816 INFO:teuthology.orchestra.run.smithi005.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 385 kB/s | 19 kB 00:00 2023-11-01T03:07:53.833 INFO:teuthology.orchestra.run.smithi005.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 403 kB/s | 20 kB 00:00 2023-11-01T03:07:53.867 INFO:teuthology.orchestra.run.smithi005.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2023-11-01T03:07:53.892 INFO:teuthology.orchestra.run.smithi005.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2023-11-01T03:07:53.918 INFO:teuthology.orchestra.run.smithi005.stdout:(26/33): python3-jaraco-classes-3.2.1-5.el9.noa 75 kB/s | 18 kB 00:00 2023-11-01T03:07:53.943 INFO:teuthology.orchestra.run.smithi005.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2023-11-01T03:07:53.993 INFO:teuthology.orchestra.run.smithi005.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2023-11-01T03:07:54.060 INFO:teuthology.orchestra.run.smithi005.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-11-01T03:07:54.085 INFO:teuthology.orchestra.run.smithi005.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 538 kB/s | 90 kB 00:00 2023-11-01T03:07:54.119 INFO:teuthology.orchestra.run.smithi005.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-01T03:07:54.144 INFO:teuthology.orchestra.run.smithi005.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 341 kB/s | 20 kB 00:00 2023-11-01T03:07:54.361 INFO:teuthology.orchestra.run.smithi005.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.5 MB/s | 427 kB 00:00 2023-11-01T03:07:54.368 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:07:54.368 INFO:teuthology.orchestra.run.smithi005.stdout:Total 11 MB/s | 30 MB 00:02 2023-11-01T03:07:54.402 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:07:54.445 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:07:54.445 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:07:54.836 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:07:54.837 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:07:55.141 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): ceph-test-18.0.0-6776.g420cd129.el9.x86_ 15 MB/s | 41 MB 00:02 2023-11-01T03:07:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:07:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:Total 14 MB/s | 42 MB 00:03 2023-11-01T03:07:55.158 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:07:55.179 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:07:55.179 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:07:55.533 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:07:55.534 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:07:56.065 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:07:56.097 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:07:56.147 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-01T03:07:56.164 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-01T03:07:56.183 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-01T03:07:56.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-01T03:07:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-01T03:07:56.230 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-01T03:07:56.271 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-01T03:07:56.294 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-01T03:07:56.325 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-01T03:07:56.402 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-01T03:07:56.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-01T03:07:56.487 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-01T03:07:56.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-01T03:07:56.629 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-01T03:07:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-01T03:07:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-01T03:07:56.781 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-01T03:07:56.987 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-01T03:07:57.038 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-01T03:07:57.082 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-01T03:07:57.119 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-01T03:07:57.149 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-01T03:07:57.219 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-01T03:07:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-01T03:07:57.285 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-01T03:07:57.327 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-01T03:07:57.361 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-01T03:07:57.453 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-01T03:07:57.496 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-01T03:07:57.574 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-01T03:07:57.715 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-01T03:07:57.847 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-01T03:07:58.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 28/33 2023-11-01T03:07:58.038 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-01T03:07:58.064 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-01T03:07:58.064 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:07:58.064 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-01T03:07:58.064 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-01T03:07:58.064 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-01T03:07:58.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:07:59.682 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-01T03:07:59.711 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-01T03:07:59.711 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:07:59.712 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-01T03:07:59.712 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-01T03:07:59.712 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-01T03:07:59.712 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:00.174 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-01T03:08:00.198 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-01T03:08:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:08:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-01T03:08:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-01T03:08:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-01T03:08:00.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:00.240 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-01T03:08:00.317 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-01T03:08:00.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-01T03:08:00.441 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-01T03:08:00.441 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:08:00.441 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-01T03:08:00.442 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-01T03:08:00.442 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-01T03:08:00.442 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:00.508 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-01T03:08:02.184 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-01T03:08:02.184 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 1/33 2023-11-01T03:08:02.185 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2/33 2023-11-01T03:08:02.185 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 3/33 2023-11-01T03:08:02.185 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 4/33 2023-11-01T03:08:02.185 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 5/33 2023-11-01T03:08:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 6/33 2023-11-01T03:08:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-01T03:08:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-01T03:08:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-01T03:08:02.186 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-01T03:08:02.187 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-01T03:08:02.187 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-01T03:08:02.187 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-01T03:08:02.187 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-01T03:08:02.187 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-01T03:08:02.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-01T03:08:02.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-01T03:08:02.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-01T03:08:02.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-01T03:08:02.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-01T03:08:02.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-01T03:08:02.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-01T03:08:02.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-01T03:08:02.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-01T03:08:02.189 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-01T03:08:02.190 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-01T03:08:02.190 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-01T03:08:02.191 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-01T03:08:02.191 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-01T03:08:02.191 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-01T03:08:02.191 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-01T03:08:02.191 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-01T03:08:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-01T03:08:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 1/6 2023-11-01T03:08:02.509 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2/6 2023-11-01T03:08:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-01T03:08:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-01T03:08:02.510 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-01T03:08:02.919 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-01T03:08:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:08:02.920 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:08:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:02.920 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-15.el9.x86_64 2023-11-01T03:08:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-01T03:08:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-01T03:08:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-01T03:08:02.921 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:08:02.922 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:08:03.036 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-01T03:08:03.037 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:03.037 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:03.037 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:03.037 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:03.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:03.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:03.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:03.038 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:03.038 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-01T03:08:03.039 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-01T03:08:03.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-01T03:08:03.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-01T03:08:03.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-01T03:08:03.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-01T03:08:03.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-01T03:08:03.041 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-01T03:08:03.042 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-01T03:08:03.043 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-01T03:08:03.043 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-01T03:08:03.043 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-01T03:08:03.043 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:03.043 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:03.253 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph 2023-11-01T03:08:03.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base 2023-11-01T03:08:03.814 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:38 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:08:03.866 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:57 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:03.958 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:08:03.960 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================= 2023-11-01T03:08:03.960 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:08:03.961 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================= 2023-11-01T03:08:03.961 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:08:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.0.0-6776.g420cd129.el9 ceph 6.5 k 2023-11-01T03:08:03.961 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:08:03.961 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.0.0-6776.g420cd129.el9 ceph 2.1 M 2023-11-01T03:08:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.5 M 2023-11-01T03:08:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 243 k 2023-11-01T03:08:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.4 M 2023-11-01T03:08:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 18 M 2023-11-01T03:08:03.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-01T03:08:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-01T03:08:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-01T03:08:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-01T03:08:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-01T03:08:03.963 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-01T03:08:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-01T03:08:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-01T03:08:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-01T03:08:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-01T03:08:03.964 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-01T03:08:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-01T03:08:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-01T03:08:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-01T03:08:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-01T03:08:03.965 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-01T03:08:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-01T03:08:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-01T03:08:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-01T03:08:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-01T03:08:03.966 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-01T03:08:03.967 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-01T03:08:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:08:03.968 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:08:03.968 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================= 2023-11-01T03:08:03.968 INFO:teuthology.orchestra.run.smithi153.stdout:Install 33 Packages 2023-11-01T03:08:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:08:03.969 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:03.970 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 30 M 2023-11-01T03:08:03.970 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 110 M 2023-11-01T03:08:03.970 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:08:04.014 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:04.015 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:04.015 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:04.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install cephadm 2023-11-01T03:08:04.642 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:58 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:04.787 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:04.788 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:04.788 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:04.789 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:04.789 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:04.789 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 270 k 2023-11-01T03:08:04.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:04.789 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 270 k 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 265 k 2023-11-01T03:08:04.790 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:05.001 INFO:teuthology.orchestra.run.smithi153.stdout:(1/33): ceph-18.0.0-6776.g420cd129.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2023-11-01T03:08:05.032 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm-18.0.0-6776.g420cd129.el9.noarch.rpm 1.1 MB/s | 270 kB 00:00 2023-11-01T03:08:05.033 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:05.034 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.1 MB/s | 270 kB 00:00 2023-11-01T03:08:05.034 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:05.039 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:05.039 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:05.042 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:05.042 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:05.117 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:05.194 INFO:teuthology.orchestra.run.smithi153.stdout:(2/33): ceph-mds-18.0.0-6776.g420cd129.el9.x86_ 5.3 MB/s | 2.1 MB 00:00 2023-11-01T03:08:05.235 INFO:teuthology.orchestra.run.smithi153.stdout:(3/33): ceph-mgr-18.0.0-6776.g420cd129.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2023-11-01T03:08:05.360 INFO:teuthology.orchestra.run.smithi153.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6776.g420c 1.9 MB/s | 243 kB 00:00 2023-11-01T03:08:05.461 INFO:teuthology.orchestra.run.smithi153.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-11-01T03:08:05.486 INFO:teuthology.orchestra.run.smithi153.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-11-01T03:08:05.520 INFO:teuthology.orchestra.run.smithi153.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-01T03:08:05.531 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:05.561 INFO:teuthology.orchestra.run.smithi153.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-11-01T03:08:05.595 INFO:teuthology.orchestra.run.smithi153.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-01T03:08:05.629 INFO:teuthology.orchestra.run.smithi153.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-11-01T03:08:05.630 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:05.662 INFO:teuthology.orchestra.run.smithi153.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-11-01T03:08:05.704 INFO:teuthology.orchestra.run.smithi153.stdout:(12/33): python3-urllib3-1.26.5-4.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2023-11-01T03:08:06.013 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:06.055 INFO:teuthology.orchestra.run.smithi153.stdout:(13/33): ceph-osd-18.0.0-6776.g420cd129.el9.x86 21 MB/s | 18 MB 00:00 2023-11-01T03:08:06.104 INFO:teuthology.orchestra.run.smithi153.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2023-11-01T03:08:06.180 INFO:teuthology.orchestra.run.smithi153.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 411 kB/s | 51 kB 00:00 2023-11-01T03:08:06.255 INFO:teuthology.orchestra.run.smithi153.stdout:(16/33): ceph-mon-18.0.0-6776.g420cd129.el9.x86 3.5 MB/s | 4.4 MB 00:01 2023-11-01T03:08:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:06.307 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:06.307 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:06.308 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:06.308 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:06.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-immutable-object-cache 2023-11-01T03:08:07.085 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:01 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:07.231 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:07.232 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:07.232 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:08:07.232 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:07.232 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:07.232 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6776.g420cd129.el9 ceph 142 k 2023-11-01T03:08:07.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:07.233 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:07.233 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:07.233 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:07.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:07.234 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 142 k 2023-11-01T03:08:07.234 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 400 k 2023-11-01T03:08:07.234 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:07.448 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-immutable-object-cache-18.0.0-6776.g420cd1 658 kB/s | 142 kB 00:00 2023-11-01T03:08:07.448 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:07.449 INFO:teuthology.orchestra.run.smithi005.stdout:Total 654 kB/s | 142 kB 00:00 2023-11-01T03:08:07.449 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:07.457 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:07.457 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:07.512 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:07.513 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:07.652 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:07.707 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:08:07.732 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:08:07.733 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:08:07.733 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-01T03:08:07.733 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:08:08.682 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:08.682 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:08.683 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:08.683 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:08.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr 2023-11-01T03:08:09.480 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:03 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:09.578 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:09.631 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:09.632 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:09.633 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:09.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-dashboard 2023-11-01T03:08:10.274 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:04 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:10.420 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:10.420 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:10.421 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:10.421 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:10.421 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:10.421 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 1.8 M 2023-11-01T03:08:10.421 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 23 k 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 15 k 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-01T03:08:10.422 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2023-11-01T03:08:10.423 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-01T03:08:10.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:10.423 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:10.423 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:10.423 INFO:teuthology.orchestra.run.smithi005.stdout:Install 7 Packages 2023-11-01T03:08:10.424 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:10.424 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.1 M 2023-11-01T03:08:10.425 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 8.6 M 2023-11-01T03:08:10.425 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:10.818 INFO:teuthology.orchestra.run.smithi005.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6776.g420 106 kB/s | 23 kB 00:00 2023-11-01T03:08:10.843 INFO:teuthology.orchestra.run.smithi005.stdout:(2/7): ceph-prometheus-alerts-18.0.0-6776.g420c 62 kB/s | 15 kB 00:00 2023-11-01T03:08:10.960 INFO:teuthology.orchestra.run.smithi005.stdout:(3/7): ceph-mgr-dashboard-18.0.0-6776.g420cd129 4.9 MB/s | 1.8 MB 00:00 2023-11-01T03:08:11.535 INFO:teuthology.orchestra.run.smithi005.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 13 kB/s | 9.0 kB 00:00 2023-11-01T03:08:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 31 kB/s | 172 kB 00:05 2023-11-01T03:08:11.827 INFO:teuthology.orchestra.run.smithi005.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 35 kB/s | 31 kB 00:00 2023-11-01T03:08:11.911 INFO:teuthology.orchestra.run.smithi005.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 38 kB/s | 41 kB 00:01 2023-11-01T03:08:12.205 INFO:teuthology.orchestra.run.smithi153.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 22 kB/s | 11 kB 00:00 2023-11-01T03:08:12.363 INFO:teuthology.orchestra.run.smithi153.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 112 kB/s | 18 kB 00:00 2023-11-01T03:08:12.378 INFO:teuthology.orchestra.run.smithi005.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 224 kB/s | 188 kB 00:00 2023-11-01T03:08:12.382 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:12.383 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.1 MB/s | 2.1 MB 00:01 2023-11-01T03:08:12.383 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:12.393 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:12.393 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:12.447 INFO:teuthology.orchestra.run.smithi153.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 278 kB/s | 23 kB 00:00 2023-11-01T03:08:12.467 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:12.467 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:12.505 INFO:teuthology.orchestra.run.smithi153.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 333 kB/s | 19 kB 00:00 2023-11-01T03:08:12.547 INFO:teuthology.orchestra.run.smithi153.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 472 kB/s | 20 kB 00:00 2023-11-01T03:08:12.631 INFO:teuthology.orchestra.run.smithi153.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 555 kB/s | 46 kB 00:00 2023-11-01T03:08:12.711 INFO:teuthology.orchestra.run.smithi153.stdout:(24/33): python3-more-itertools-8.12.0-2.el9.no 991 kB/s | 79 kB 00:00 2023-11-01T03:08:12.777 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:12.823 INFO:teuthology.orchestra.run.smithi153.stdout:(25/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-11-01T03:08:12.837 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-01T03:08:12.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-01T03:08:12.873 INFO:teuthology.orchestra.run.smithi153.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2023-11-01T03:08:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-01T03:08:12.940 INFO:teuthology.orchestra.run.smithi153.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2023-11-01T03:08:12.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-01T03:08:12.978 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 5/7 2023-11-01T03:08:12.982 INFO:teuthology.orchestra.run.smithi153.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 862 kB/s | 36 kB 00:00 2023-11-01T03:08:13.082 INFO:teuthology.orchestra.run.smithi153.stdout:(29/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-11-01T03:08:13.216 INFO:teuthology.orchestra.run.smithi153.stdout:(30/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2023-11-01T03:08:13.229 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 6/7 2023-11-01T03:08:13.256 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-01T03:08:13.258 INFO:teuthology.orchestra.run.smithi153.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2023-11-01T03:08:13.813 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-01T03:08:13.814 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 1/7 2023-11-01T03:08:13.814 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 2/7 2023-11-01T03:08:13.814 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 3/7 2023-11-01T03:08:13.814 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-01T03:08:13.814 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-01T03:08:13.815 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-01T03:08:14.253 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-01T03:08:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:14.254 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:14.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-01T03:08:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-01T03:08:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-01T03:08:14.255 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-01T03:08:14.256 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:14.256 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:14.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-01T03:08:15.015 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:09 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:15.163 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:15.164 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2023-11-01T03:08:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:15.165 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2023-11-01T03:08:15.165 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 7.4 M 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-01T03:08:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-01T03:08:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-01T03:08:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:15.168 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:15.168 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2023-11-01T03:08:15.168 INFO:teuthology.orchestra.run.smithi005.stdout:Install 12 Packages 2023-11-01T03:08:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:15.169 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 37 M 2023-11-01T03:08:15.169 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 209 M 2023-11-01T03:08:15.170 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:15.301 INFO:teuthology.orchestra.run.smithi005.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 236 kB/s | 32 kB 00:00 2023-11-01T03:08:15.334 INFO:teuthology.orchestra.run.smithi005.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 528 kB/s | 17 kB 00:00 2023-11-01T03:08:15.401 INFO:teuthology.orchestra.run.smithi005.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-11-01T03:08:15.427 INFO:teuthology.orchestra.run.smithi005.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 380 kB/s | 34 kB 00:00 2023-11-01T03:08:15.433 INFO:teuthology.orchestra.run.smithi153.stdout:(32/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 4.7 kB/s | 43 kB 00:09 2023-11-01T03:08:15.469 INFO:teuthology.orchestra.run.smithi005.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 205 kB 00:00 2023-11-01T03:08:15.536 INFO:teuthology.orchestra.run.smithi005.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-11-01T03:08:15.611 INFO:teuthology.orchestra.run.smithi005.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-01T03:08:15.636 INFO:teuthology.orchestra.run.smithi005.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-01T03:08:15.720 INFO:teuthology.orchestra.run.smithi005.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.7 MB/s | 803 kB 00:00 2023-11-01T03:08:15.904 INFO:teuthology.orchestra.run.smithi005.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 54 MB/s | 16 MB 00:00 2023-11-01T03:08:15.929 INFO:teuthology.orchestra.run.smithi005.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 946 kB/s | 195 kB 00:00 2023-11-01T03:08:16.488 INFO:teuthology.orchestra.run.smithi005.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 5.6 MB/s | 7.4 MB 00:01 2023-11-01T03:08:16.490 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:16.491 INFO:teuthology.orchestra.run.smithi005.stdout:Total 28 MB/s | 37 MB 00:01 2023-11-01T03:08:16.491 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:16.516 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:16.516 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:17.685 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:17.744 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-01T03:08:17.775 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-01T03:08:17.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-01T03:08:17.903 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-01T03:08:18.094 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-01T03:08:18.119 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-01T03:08:18.205 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-01T03:08:18.879 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-01T03:08:18.996 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-01T03:08:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-01T03:08:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-01T03:08:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-01T03:08:23.900 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-01T03:08:23.900 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 1/12 2023-11-01T03:08:23.901 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-01T03:08:23.901 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-01T03:08:23.901 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-01T03:08:23.901 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-01T03:08:23.901 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-01T03:08:23.902 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-01T03:08:23.902 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-01T03:08:23.902 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-01T03:08:23.902 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-01T03:08:23.902 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-01T03:08:24.352 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-01T03:08:24.353 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:24.353 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:24.353 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:24.353 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-01T03:08:24.354 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-01T03:08:24.354 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-01T03:08:24.354 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-01T03:08:24.354 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-01T03:08:24.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-01T03:08:24.356 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:24.356 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:24.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-rook 2023-11-01T03:08:25.278 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:19 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:25.427 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:25.429 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 48 k 2023-11-01T03:08:25.429 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-01T03:08:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-01T03:08:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-01T03:08:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-01T03:08:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-01T03:08:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-01T03:08:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-01T03:08:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-01T03:08:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-01T03:08:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-01T03:08:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-01T03:08:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-01T03:08:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:25.432 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:25.432 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:25.432 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2023-11-01T03:08:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:25.433 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.0 M 2023-11-01T03:08:25.433 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 26 M 2023-11-01T03:08:25.433 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:25.919 INFO:teuthology.orchestra.run.smithi005.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 202 kB/s | 24 kB 00:00 2023-11-01T03:08:25.945 INFO:teuthology.orchestra.run.smithi005.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 124 kB/s | 18 kB 00:00 2023-11-01T03:08:25.995 INFO:teuthology.orchestra.run.smithi005.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2023-11-01T03:08:26.021 INFO:teuthology.orchestra.run.smithi005.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-01T03:08:26.046 INFO:teuthology.orchestra.run.smithi005.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-01T03:08:26.063 INFO:teuthology.orchestra.run.smithi005.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2023-11-01T03:08:26.080 INFO:teuthology.orchestra.run.smithi005.stdout:(7/13): ceph-mgr-rook-18.0.0-6776.g420cd129.el9 170 kB/s | 48 kB 00:00 2023-11-01T03:08:26.222 INFO:teuthology.orchestra.run.smithi005.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 183 kB/s | 32 kB 00:00 2023-11-01T03:08:26.255 INFO:teuthology.orchestra.run.smithi005.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2023-11-01T03:08:26.305 INFO:teuthology.orchestra.run.smithi005.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-11-01T03:08:26.331 INFO:teuthology.orchestra.run.smithi005.stdout:(11/13): python3-google-auth-2.23.3-1.el9.noarc 979 kB/s | 197 kB 00:00 2023-11-01T03:08:26.364 INFO:teuthology.orchestra.run.smithi005.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2023-11-01T03:08:26.540 INFO:teuthology.orchestra.run.smithi005.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2023-11-01T03:08:26.544 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:26.544 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2023-11-01T03:08:26.544 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:26.558 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:26.558 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:26.665 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:26.667 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-01T03:08:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-01T03:08:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-01T03:08:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-01T03:08:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-01T03:08:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-01T03:08:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-01T03:08:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-01T03:08:28.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-01T03:08:28.674 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-01T03:08:28.713 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-01T03:08:28.754 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-01T03:08:28.769 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-01T03:08:29.560 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-01T03:08:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 1/13 2023-11-01T03:08:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-01T03:08:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-01T03:08:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-01T03:08:29.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-01T03:08:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-01T03:08:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-01T03:08:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-01T03:08:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-01T03:08:29.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-01T03:08:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-01T03:08:29.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-01T03:08:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-01T03:08:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:29.932 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-01T03:08:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-01T03:08:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-01T03:08:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-01T03:08:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:29.935 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:30.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-cephadm 2023-11-01T03:08:30.723 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:24 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:30.871 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:30.872 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:30.872 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:30.872 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:30.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 132 k 2023-11-01T03:08:30.873 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-01T03:08:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-01T03:08:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-01T03:08:30.873 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-01T03:08:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-01T03:08:30.874 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:30.874 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:30.874 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:08:30.874 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2023-11-01T03:08:30.875 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:30.875 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 6.8 M 2023-11-01T03:08:30.875 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 33 M 2023-11-01T03:08:30.876 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:31.384 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-11-01T03:08:31.492 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-01T03:08:31.568 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6776.g420cd129.e 392 kB/s | 132 kB 00:00 2023-11-01T03:08:31.976 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 126 kB/s | 58 kB 00:00 2023-11-01T03:08:32.001 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 118 kB/s | 51 kB 00:00 2023-11-01T03:08:32.126 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 739 kB/s | 548 kB 00:00 2023-11-01T03:08:32.131 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:32.131 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.4 MB/s | 6.8 MB 00:01 2023-11-01T03:08:32.131 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:32.142 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:32.142 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:32.242 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:32.242 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:32.548 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:32.725 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-01T03:08:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-01T03:08:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-01T03:08:33.426 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-01T03:08:33.494 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-01T03:08:33.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-01T03:08:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-01T03:08:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/6 2023-11-01T03:08:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-01T03:08:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-01T03:08:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-01T03:08:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-01T03:08:34.613 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-01T03:08:34.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:34.614 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:34.614 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:34.614 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-01T03:08:34.615 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-01T03:08:34.615 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-01T03:08:34.615 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-01T03:08:34.615 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-01T03:08:34.615 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:34.616 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:34.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse 2023-11-01T03:08:35.436 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:29 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:35.583 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:35.583 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 855 k 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:Install 2 Packages 2023-11-01T03:08:35.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 934 k 2023-11-01T03:08:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.7 M 2023-11-01T03:08:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:35.704 INFO:teuthology.orchestra.run.smithi005.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 654 kB/s | 79 kB 00:00 2023-11-01T03:08:35.971 INFO:teuthology.orchestra.run.smithi005.stdout:(2/2): ceph-fuse-18.0.0-6776.g420cd129.el9.x86_ 2.2 MB/s | 855 kB 00:00 2023-11-01T03:08:35.973 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:35.973 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.3 MB/s | 934 kB 00:00 2023-11-01T03:08:35.973 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:36.075 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:36.266 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-01T03:08:36.473 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:08:37.158 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:08:37.159 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-01T03:08:37.497 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-01T03:08:37.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:37.498 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-01T03:08:37.498 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:37.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-volume 2023-11-01T03:08:38.378 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:32 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:38.525 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:38.526 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:38.526 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-11-01T03:08:38.527 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:38.527 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:38.527 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 262 k 2023-11-01T03:08:38.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:38.527 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:38.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 262 k 2023-11-01T03:08:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.2 M 2023-11-01T03:08:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:38.759 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-volume-18.0.0-6776.g420cd129.el9.noarch.rp 1.1 MB/s | 262 kB 00:00 2023-11-01T03:08:38.760 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:38.760 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.1 MB/s | 262 kB 00:00 2023-11-01T03:08:38.760 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:38.769 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:38.769 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:38.807 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:38.808 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:39.119 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:08:39.120 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-01T03:08:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:08:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:40.170 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:08:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:40.170 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:40.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados-devel 2023-11-01T03:08:41.075 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:35 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:41.223 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:41.224 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:41.224 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:08:41.224 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:41.225 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:41.225 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 126 k 2023-11-01T03:08:41.225 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:41.225 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:41.225 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:41.226 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:41.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:41.226 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 126 k 2023-11-01T03:08:41.226 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 456 k 2023-11-01T03:08:41.226 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:41.441 INFO:teuthology.orchestra.run.smithi005.stdout:librados-devel-18.0.0-6776.g420cd129.el9.x86_64 585 kB/s | 126 kB 00:00 2023-11-01T03:08:41.442 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:41.442 INFO:teuthology.orchestra.run.smithi005.stdout:Total 581 kB/s | 126 kB 00:00 2023-11-01T03:08:41.442 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:41.448 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:41.448 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:41.507 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:41.507 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:41.654 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:41.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:42.170 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:42.469 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:42.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:42.469 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:42.470 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:42.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:42.470 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:42.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2 2023-11-01T03:08:43.303 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:37 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:43.398 INFO:teuthology.orchestra.run.smithi005.stdout:Package libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:43.450 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:43.451 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:43.452 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:43.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs-devel 2023-11-01T03:08:44.083 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:38 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:44.230 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:44.231 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:44.231 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:08:44.232 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:44.232 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:44.232 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 31 k 2023-11-01T03:08:44.232 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:44.232 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:44.233 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:44.233 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:44.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:44.233 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 31 k 2023-11-01T03:08:44.233 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 139 k 2023-11-01T03:08:44.234 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:44.436 INFO:teuthology.orchestra.run.smithi005.stdout:libcephfs-devel-18.0.0-6776.g420cd129.el9.x86_6 152 kB/s | 31 kB 00:00 2023-11-01T03:08:44.437 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:44.438 INFO:teuthology.orchestra.run.smithi005.stdout:Total 151 kB/s | 31 kB 00:00 2023-11-01T03:08:44.438 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:44.441 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:44.442 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:44.470 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:44.471 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:44.568 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:44.687 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:45.063 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:45.333 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:45.334 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:45.334 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:45.335 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:45.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2 2023-11-01T03:08:46.087 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:40 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:46.180 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:46.234 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:46.235 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:46.235 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:46.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1 2023-11-01T03:08:46.886 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:40 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:46.979 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:47.032 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:47.033 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:47.034 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:47.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rados 2023-11-01T03:08:47.668 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:41 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:47.763 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:47.815 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:47.817 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:47.817 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:47.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rgw 2023-11-01T03:08:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:42 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:48.556 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:48.608 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:48.609 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:48.610 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:48.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-cephfs 2023-11-01T03:08:49.256 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:43 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:49.351 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:49.404 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:49.405 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:49.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rbd 2023-11-01T03:08:50.044 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:44 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:50.138 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:08:50.191 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:50.192 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:08:50.192 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:50.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse 2023-11-01T03:08:50.841 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:44 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:50.987 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:50.988 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:50.988 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2023-11-01T03:08:50.989 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:50.989 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:50.989 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 85 k 2023-11-01T03:08:50.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:50.989 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:50.990 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:50.990 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:50.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:50.990 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 85 k 2023-11-01T03:08:50.990 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 227 k 2023-11-01T03:08:50.991 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-fuse-18.0.0-6776.g420cd129.el9.x86_64.rpm 390 kB/s | 85 kB 00:00 2023-11-01T03:08:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:Total 388 kB/s | 85 kB 00:00 2023-11-01T03:08:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:51.414 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:51.937 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:52.230 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:52.231 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:52.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-mirror 2023-11-01T03:08:53.028 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:47 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:53.176 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:53.177 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:53.178 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:08:53.178 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:53.178 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:53.178 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-01T03:08:53.178 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:53.179 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:53.179 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:53.179 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:53.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:53.180 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 3.0 M 2023-11-01T03:08:53.180 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 12 M 2023-11-01T03:08:53.180 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:53.702 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-mirror-18.0.0-6776.g420cd129.el9.x86_64.rpm 5.8 MB/s | 3.0 MB 00:00 2023-11-01T03:08:53.703 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:53.704 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.8 MB/s | 3.0 MB 00:00 2023-11-01T03:08:53.704 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:53.713 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:53.713 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:53.790 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:53.791 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:54.232 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:54.303 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:54.328 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:54.328 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:08:54.329 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-01T03:08:54.329 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-01T03:08:54.329 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-01T03:08:54.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:55.462 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:55.462 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:55.463 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:55.463 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:55.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-nbd 2023-11-01T03:08:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:50 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:56.419 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:56.420 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:56.420 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2023-11-01T03:08:56.421 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:56.421 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:56.421 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 169 k 2023-11-01T03:08:56.421 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:56.421 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 169 k 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 490 k 2023-11-01T03:08:56.422 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:08:56.747 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-nbd-18.0.0-6776.g420cd129.el9.x86_64.rpm 518 kB/s | 169 kB 00:00 2023-11-01T03:08:56.748 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:08:56.748 INFO:teuthology.orchestra.run.smithi005.stdout:Total 516 kB/s | 169 kB 00:00 2023-11-01T03:08:56.748 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:08:56.757 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:08:56.757 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:08:56.816 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:08:56.816 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:08:56.965 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:08:57.064 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:57.474 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:57.770 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:08:57.770 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:57.771 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:08:57.771 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:08:57.771 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:57.771 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:08:58.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base-debuginfo 2023-11-01T03:08:58.645 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:52 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:08:58.801 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:08:58.803 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:58.803 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:08:58.803 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:58.803 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:08:58.804 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 74 M 2023-11-01T03:08:58.804 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-11-01T03:08:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 21 M 2023-11-01T03:08:58.805 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:58.805 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:08:58.806 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:08:58.806 INFO:teuthology.orchestra.run.smithi005.stdout:Install 2 Packages 2023-11-01T03:08:58.806 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:08:58.807 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 95 M 2023-11-01T03:08:58.807 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 515 M 2023-11-01T03:08:58.807 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:09:01.443 INFO:teuthology.orchestra.run.smithi005.stdout:(1/2): ceph-debuginfo-18.0.0-6776.g420cd129.el9 8.0 MB/s | 21 MB 00:02 2023-11-01T03:09:05.526 INFO:teuthology.orchestra.run.smithi005.stdout:(2/2): ceph-base-debuginfo-18.0.0-6776.g420cd12 11 MB/s | 74 MB 00:06 2023-11-01T03:09:05.528 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:05.528 INFO:teuthology.orchestra.run.smithi005.stdout:Total 14 MB/s | 95 MB 00:06 2023-11-01T03:09:05.529 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:09:05.534 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:09:05.534 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:09:06.182 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:09:06.182 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:09:09.338 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:09:12.674 INFO:teuthology.orchestra.run.smithi153.stdout:(33/33): python3-cherrypy-18.6.1-2.el9.noarch.r 5.4 kB/s | 358 kB 01:06 2023-11-01T03:09:12.678 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:12.678 INFO:teuthology.orchestra.run.smithi153.stdout:Total 446 kB/s | 30 MB 01:08 2023-11-01T03:09:12.708 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:12.748 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:12.748 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:13.122 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:14.359 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:14.427 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-01T03:09:14.459 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-01T03:09:14.492 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-01T03:09:14.584 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-01T03:09:14.661 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-01T03:09:14.703 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-01T03:09:14.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-01T03:09:14.809 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-01T03:09:14.871 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-01T03:09:14.909 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-01T03:09:14.957 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-01T03:09:15.014 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-01T03:09:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-01T03:09:15.255 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-01T03:09:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-01T03:09:15.328 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-01T03:09:15.358 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-01T03:09:15.435 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-01T03:09:15.468 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-01T03:09:15.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-01T03:09:15.544 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-01T03:09:15.578 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-01T03:09:15.667 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-01T03:09:15.718 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-01T03:09:15.789 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-01T03:09:15.926 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-01T03:09:16.051 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-01T03:09:16.211 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 28/33 2023-11-01T03:09:16.238 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-01T03:09:16.262 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-01T03:09:16.262 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:16.263 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-01T03:09:16.263 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-01T03:09:16.263 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-01T03:09:16.263 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:17.457 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-01T03:09:17.528 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-01T03:09:17.815 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-01T03:09:17.842 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-01T03:09:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-01T03:09:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-01T03:09:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-01T03:09:17.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:18.282 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-01T03:09:18.304 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-01T03:09:18.305 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:18.305 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-01T03:09:18.305 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-01T03:09:18.305 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-01T03:09:18.306 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:18.524 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-01T03:09:18.546 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-01T03:09:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-01T03:09:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-01T03:09:18.547 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-01T03:09:18.548 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:18.613 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-01T03:09:20.279 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-01T03:09:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 1/33 2023-11-01T03:09:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2/33 2023-11-01T03:09:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 3/33 2023-11-01T03:09:20.280 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 4/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 5/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 6/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-01T03:09:20.281 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-01T03:09:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-01T03:09:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-01T03:09:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-01T03:09:20.282 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-01T03:09:20.283 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-01T03:09:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-01T03:09:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-01T03:09:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-01T03:09:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-01T03:09:20.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-01T03:09:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-01T03:09:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-01T03:09:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-01T03:09:20.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-01T03:09:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-01T03:09:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-01T03:09:20.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-01T03:09:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-01T03:09:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/2 2023-11-01T03:09:21.280 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.281 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-01T03:09:21.282 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-01T03:09:21.283 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-01T03:09:21.284 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-01T03:09:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-01T03:09:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2023-11-01T03:09:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-01T03:09:21.285 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-01T03:09:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-01T03:09:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-01T03:09:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-01T03:09:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-01T03:09:21.286 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-01T03:09:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-01T03:09:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-01T03:09:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-01T03:09:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-01T03:09:21.287 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:21.288 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:09:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:09:21.313 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:09:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:09:21.314 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:09:21.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-common-debuginfo 2023-11-01T03:09:21.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base 2023-11-01T03:09:22.106 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:16 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:09:22.188 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:57 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:22.254 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:09:22.255 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:09:22.255 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:09:22.255 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:09:22.255 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:09:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 408 M 2023-11-01T03:09:22.256 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:09:22.256 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:09:22.256 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:09:22.257 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:09:22.257 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:09:22.257 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 408 M 2023-11-01T03:09:22.257 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.6 G 2023-11-01T03:09:22.258 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:09:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:09:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:09:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:22.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install cephadm 2023-11-01T03:09:22.945 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:57 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:23.085 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:23.086 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:23.086 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 270 k 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:23.087 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:09:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:23.088 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 270 k 2023-11-01T03:09:23.088 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 265 k 2023-11-01T03:09:23.088 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:23.847 INFO:teuthology.orchestra.run.smithi153.stdout:cephadm-18.0.0-6776.g420cd129.el9.noarch.rpm 355 kB/s | 270 kB 00:00 2023-11-01T03:09:23.848 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:23.848 INFO:teuthology.orchestra.run.smithi153.stdout:Total 354 kB/s | 270 kB 00:00 2023-11-01T03:09:23.848 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:23.853 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:23.854 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:23.857 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:23.857 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:23.926 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:24.381 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:24.469 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:24.885 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:25.182 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:25.182 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:25.182 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:25.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache 2023-11-01T03:09:25.939 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:00 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:26.082 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:26.083 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:26.083 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:09:26.083 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:26.083 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6776.g420cd129.el9 ceph 142 k 2023-11-01T03:09:26.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:26.084 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:26.084 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:26.084 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:09:26.085 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:26.085 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 142 k 2023-11-01T03:09:26.085 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 400 k 2023-11-01T03:09:26.085 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:26.369 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-18.0.0-6776.g420cd1 496 kB/s | 142 kB 00:00 2023-11-01T03:09:26.370 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:26.371 INFO:teuthology.orchestra.run.smithi153.stdout:Total 493 kB/s | 142 kB 00:00 2023-11-01T03:09:26.371 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:26.378 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:26.378 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:26.429 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:26.430 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:26.568 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:26.629 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:09:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:09:26.653 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:26.654 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-01T03:09:26.654 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-01T03:09:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:27.634 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:09:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:27.635 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:27.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr 2023-11-01T03:09:28.468 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:03 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:28.559 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:09:28.607 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:09:28.608 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:28.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-dashboard 2023-11-01T03:09:29.220 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:04 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:29.361 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:29.371 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:29.371 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:29.372 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:29.372 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:29.372 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 1.8 M 2023-11-01T03:09:29.372 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:09:29.372 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 23 k 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 15 k 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2023-11-01T03:09:29.373 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-01T03:09:29.374 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:29.374 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:29.374 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:29.374 INFO:teuthology.orchestra.run.smithi153.stdout:Install 7 Packages 2023-11-01T03:09:29.374 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:29.375 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.1 M 2023-11-01T03:09:29.375 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 8.6 M 2023-11-01T03:09:29.375 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:29.690 INFO:teuthology.orchestra.run.smithi153.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6776.g420 94 kB/s | 23 kB 00:00 2023-11-01T03:09:29.731 INFO:teuthology.orchestra.run.smithi153.stdout:(2/7): ceph-prometheus-alerts-18.0.0-6776.g420c 53 kB/s | 15 kB 00:00 2023-11-01T03:09:29.899 INFO:teuthology.orchestra.run.smithi153.stdout:(3/7): ceph-mgr-dashboard-18.0.0-6776.g420cd129 3.9 MB/s | 1.8 MB 00:00 2023-11-01T03:09:29.915 INFO:teuthology.orchestra.run.smithi153.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 40 kB/s | 9.0 kB 00:00 2023-11-01T03:09:30.041 INFO:teuthology.orchestra.run.smithi153.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 132 kB/s | 41 kB 00:00 2023-11-01T03:09:30.074 INFO:teuthology.orchestra.run.smithi153.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 176 kB/s | 31 kB 00:00 2023-11-01T03:09:30.341 INFO:teuthology.orchestra.run.smithi153.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 443 kB/s | 188 kB 00:00 2023-11-01T03:09:30.343 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:30.343 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.1 MB/s | 2.1 MB 00:00 2023-11-01T03:09:30.344 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:30.353 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:30.353 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:30.420 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:30.421 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:30.737 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:30.801 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-01T03:09:30.835 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-01T03:09:30.881 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-01T03:09:30.921 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-01T03:09:30.950 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 5/7 2023-11-01T03:09:31.186 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 6/7 2023-11-01T03:09:31.220 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-01T03:09:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-01T03:09:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 1/7 2023-11-01T03:09:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 2/7 2023-11-01T03:09:31.849 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 3/7 2023-11-01T03:09:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-01T03:09:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-01T03:09:31.850 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-01T03:09:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-01T03:09:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:32.166 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:32.166 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-01T03:09:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-01T03:09:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-01T03:09:32.167 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-01T03:09:32.168 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:32.168 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:32.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-01T03:09:32.922 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:07 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:33.065 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:33.066 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2023-11-01T03:09:33.066 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:33.066 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2023-11-01T03:09:33.066 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:33.067 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 7.4 M 2023-11-01T03:09:33.067 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:09:33.067 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-01T03:09:33.067 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-01T03:09:33.068 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-01T03:09:33.068 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-01T03:09:33.068 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-01T03:09:33.068 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-01T03:09:33.068 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-01T03:09:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-01T03:09:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-01T03:09:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-01T03:09:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-01T03:09:33.069 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:33.070 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:33.070 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2023-11-01T03:09:33.070 INFO:teuthology.orchestra.run.smithi153.stdout:Install 12 Packages 2023-11-01T03:09:33.070 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:33.071 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 37 M 2023-11-01T03:09:33.071 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 209 M 2023-11-01T03:09:33.071 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:33.206 INFO:teuthology.orchestra.run.smithi153.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 32 kB 00:00 2023-11-01T03:09:33.239 INFO:teuthology.orchestra.run.smithi153.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 526 kB/s | 17 kB 00:00 2023-11-01T03:09:33.298 INFO:teuthology.orchestra.run.smithi153.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-11-01T03:09:33.323 INFO:teuthology.orchestra.run.smithi153.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 419 kB/s | 34 kB 00:00 2023-11-01T03:09:33.374 INFO:teuthology.orchestra.run.smithi153.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 4.0 MB/s | 205 kB 00:00 2023-11-01T03:09:33.449 INFO:teuthology.orchestra.run.smithi153.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 31 MB/s | 4.7 MB 00:00 2023-11-01T03:09:33.525 INFO:teuthology.orchestra.run.smithi153.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-11-01T03:09:33.550 INFO:teuthology.orchestra.run.smithi153.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-01T03:09:33.650 INFO:teuthology.orchestra.run.smithi153.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.0 MB/s | 803 kB 00:00 2023-11-01T03:09:33.809 INFO:teuthology.orchestra.run.smithi153.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 55 MB/s | 16 MB 00:00 2023-11-01T03:09:33.834 INFO:teuthology.orchestra.run.smithi153.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-11-01T03:09:33.934 INFO:teuthology.orchestra.run.smithi153.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 8.6 MB/s | 7.4 MB 00:00 2023-11-01T03:09:33.937 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:33.937 INFO:teuthology.orchestra.run.smithi153.stdout:Total 43 MB/s | 37 MB 00:00 2023-11-01T03:09:33.937 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:33.960 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:33.960 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:34.381 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:34.381 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:35.149 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-01T03:09:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-01T03:09:35.282 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-01T03:09:35.325 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-01T03:09:35.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-01T03:09:35.549 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-01T03:09:35.632 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-01T03:09:36.299 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-01T03:09:36.412 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-01T03:09:37.684 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-01T03:09:38.723 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-01T03:09:38.756 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-01T03:09:41.313 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-01T03:09:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 1/12 2023-11-01T03:09:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-01T03:09:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-01T03:09:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-01T03:09:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-01T03:09:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-01T03:09:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-01T03:09:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-01T03:09:41.315 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-01T03:09:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-01T03:09:41.316 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-01T03:09:41.743 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-01T03:09:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:41.744 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:41.744 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-01T03:09:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-01T03:09:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-01T03:09:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-01T03:09:41.745 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-01T03:09:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-01T03:09:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-01T03:09:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-01T03:09:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-01T03:09:41.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-01T03:09:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-01T03:09:41.747 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:41.747 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:42.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-rook 2023-11-01T03:09:42.660 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:17 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:42.804 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:42.805 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:42.805 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:42.806 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:42.806 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:42.806 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 48 k 2023-11-01T03:09:42.806 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-01T03:09:42.807 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-01T03:09:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-01T03:09:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-01T03:09:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-01T03:09:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-01T03:09:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-01T03:09:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-01T03:09:42.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:42.809 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:42.809 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:42.809 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2023-11-01T03:09:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:42.810 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.0 M 2023-11-01T03:09:42.810 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 26 M 2023-11-01T03:09:42.811 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:43.290 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 195 kB/s | 24 kB 00:00 2023-11-01T03:09:43.307 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 127 kB/s | 18 kB 00:00 2023-11-01T03:09:43.349 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 3.0 MB/s | 174 kB 00:00 2023-11-01T03:09:43.374 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-01T03:09:43.399 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-01T03:09:43.417 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2023-11-01T03:09:43.433 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): ceph-mgr-rook-18.0.0-6776.g420cd129.el9 178 kB/s | 48 kB 00:00 2023-11-01T03:09:43.867 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 69 kB/s | 32 kB 00:00 2023-11-01T03:09:43.892 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 31 kB/s | 15 kB 00:00 2023-11-01T03:09:44.134 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 245 kB/s | 59 kB 00:00 2023-11-01T03:09:44.243 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): python3-google-auth-2.23.3-1.el9.noarc 243 kB/s | 197 kB 00:00 2023-11-01T03:09:44.385 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 358 kB/s | 90 kB 00:00 2023-11-01T03:09:45.276 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 742 kB/s | 1.0 MB 00:01 2023-11-01T03:09:45.281 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:45.282 INFO:teuthology.orchestra.run.smithi153.stdout:Total 844 kB/s | 2.0 MB 00:02 2023-11-01T03:09:45.282 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:45.297 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:45.297 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:45.400 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:45.402 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:45.915 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:46.090 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-01T03:09:46.144 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-01T03:09:46.208 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-01T03:09:46.245 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-01T03:09:46.286 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-01T03:09:46.389 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-01T03:09:46.515 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-01T03:09:46.571 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-01T03:09:47.305 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-01T03:09:47.359 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-01T03:09:47.402 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-01T03:09:47.456 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-01T03:09:47.480 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-01T03:09:47.753 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-common-debuginfo-18.0.0-6776.g420cd129.el9 16 MB/s | 408 MB 00:25 2023-11-01T03:09:47.754 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:47.754 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 408 MB 00:25 2023-11-01T03:09:47.755 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:09:47.759 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:09:47.759 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:09:48.292 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-01T03:09:48.292 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 1/13 2023-11-01T03:09:48.292 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-01T03:09:48.293 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-01T03:09:48.293 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-01T03:09:48.293 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-01T03:09:48.293 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-01T03:09:48.293 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-01T03:09:48.294 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-01T03:09:48.294 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-01T03:09:48.294 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-01T03:09:48.294 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-01T03:09:48.295 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-01T03:09:48.673 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-01T03:09:48.674 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:48.674 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:48.674 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:48.675 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-01T03:09:48.675 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-01T03:09:48.675 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-01T03:09:48.675 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-01T03:09:48.675 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-01T03:09:48.676 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-01T03:09:48.676 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-01T03:09:48.676 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-01T03:09:48.676 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-01T03:09:48.676 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-01T03:09:48.677 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-01T03:09:48.677 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-01T03:09:48.677 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:48.677 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:48.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-cephadm 2023-11-01T03:09:49.469 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:24 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:49.614 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 132 k 2023-11-01T03:09:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:09:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-01T03:09:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-01T03:09:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-01T03:09:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-01T03:09:49.615 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-01T03:09:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:09:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2023-11-01T03:09:49.616 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 6.8 M 2023-11-01T03:09:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 33 M 2023-11-01T03:09:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-11-01T03:09:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-11-01T03:09:50.318 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:09:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:09:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6776.g420cd129.e 217 kB/s | 132 kB 00:00 2023-11-01T03:09:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 186 kB/s | 58 kB 00:00 2023-11-01T03:09:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 556 kB/s | 51 kB 00:00 2023-11-01T03:09:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 925 kB/s | 548 kB 00:00 2023-11-01T03:09:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:Total 5.9 MB/s | 6.8 MB 00:01 2023-11-01T03:09:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:51.329 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-01T03:09:51.381 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-01T03:09:51.896 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-01T03:09:51.983 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-01T03:09:52.044 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-01T03:09:52.068 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-01T03:09:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-01T03:09:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/6 2023-11-01T03:09:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-01T03:09:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-01T03:09:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-01T03:09:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-01T03:09:53.211 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-01T03:09:53.212 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:53.212 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:53.212 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:53.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-01T03:09:53.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-01T03:09:53.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-01T03:09:53.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-01T03:09:53.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-01T03:09:53.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:53.214 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:53.451 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse 2023-11-01T03:09:54.001 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:29 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:54.143 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:54.143 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:54.143 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:54.144 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:54.144 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 855 k 2023-11-01T03:09:54.144 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:09:54.144 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-01T03:09:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:54.145 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:54.145 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:54.145 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2023-11-01T03:09:54.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:54.146 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 934 k 2023-11-01T03:09:54.146 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.7 M 2023-11-01T03:09:54.146 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:54.239 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 839 kB/s | 79 kB 00:00 2023-11-01T03:09:54.864 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): ceph-fuse-18.0.0-6776.g420cd129.el9.x86_ 1.2 MB/s | 855 kB 00:00 2023-11-01T03:09:54.865 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:54.865 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.3 MB/s | 934 kB 00:00 2023-11-01T03:09:54.866 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:54.886 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:54.886 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:54.961 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:55.152 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:55.297 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-01T03:09:55.380 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:09:56.054 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:09:56.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-01T03:09:56.361 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-01T03:09:56.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:56.362 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:56.362 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-01T03:09:56.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:56.363 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:56.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-volume 2023-11-01T03:09:57.187 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:32 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:09:57.334 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:09:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-11-01T03:09:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:57.335 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:09:57.335 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 262 k 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:57.336 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 262 k 2023-11-01T03:09:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.2 M 2023-11-01T03:09:57.337 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:09:57.927 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-volume-18.0.0-6776.g420cd129.el9.noarch.rp 443 kB/s | 262 kB 00:00 2023-11-01T03:09:57.928 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:09:57.928 INFO:teuthology.orchestra.run.smithi153.stdout:Total 442 kB/s | 262 kB 00:00 2023-11-01T03:09:57.928 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:09:57.935 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:09:57.936 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:09:57.967 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:09:57.967 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:09:58.180 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:09:58.254 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:58.269 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:58.269 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:09:58.270 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-01T03:09:58.270 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:59.418 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-01T03:09:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:59.419 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:09:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-01T03:09:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:09:59.420 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:09:59.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel 2023-11-01T03:10:00.328 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:35 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:00.470 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:00.471 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:00.471 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:10:00.471 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:00.471 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 126 k 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:00.472 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:00.473 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 126 k 2023-11-01T03:10:00.473 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 456 k 2023-11-01T03:10:00.473 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:00.714 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-18.0.0-6776.g420cd129.el9.x86_64 522 kB/s | 126 kB 00:00 2023-11-01T03:10:00.715 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:00.715 INFO:teuthology.orchestra.run.smithi153.stdout:Total 519 kB/s | 126 kB 00:00 2023-11-01T03:10:00.715 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:00.720 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:00.720 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:00.776 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:00.776 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:01.038 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:01.466 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:01.759 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:01.760 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:01.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2 2023-11-01T03:10:02.563 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:37 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:02.655 INFO:teuthology.orchestra.run.smithi153.stdout:Package libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:02.705 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:02.706 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:02.707 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:02.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs-devel 2023-11-01T03:10:03.314 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:38 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:03.455 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:03.456 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 31 k 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:03.457 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:03.458 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:03.458 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 31 k 2023-11-01T03:10:03.458 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 139 k 2023-11-01T03:10:03.458 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:03.634 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs-devel-18.0.0-6776.g420cd129.el9.x86_6 176 kB/s | 31 kB 00:00 2023-11-01T03:10:03.635 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:03.635 INFO:teuthology.orchestra.run.smithi153.stdout:Total 175 kB/s | 31 kB 00:00 2023-11-01T03:10:03.635 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:03.638 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:03.638 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:03.682 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:03.683 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:03.775 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:03.873 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:04.285 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:04.567 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:04.568 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:04.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:04.569 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:04.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2 2023-11-01T03:10:05.290 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:40 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:05.380 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:05.430 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:05.431 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:05.431 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:05.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1 2023-11-01T03:10:06.043 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:41 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:06.133 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:06.184 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:06.185 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:06.185 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:06.251 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados 2023-11-01T03:10:06.798 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:41 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:06.888 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:06.937 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:06.938 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:06.938 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:07.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw 2023-11-01T03:10:07.544 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:42 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:07.635 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:07.683 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:07.684 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:07.684 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:07.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs 2023-11-01T03:10:08.294 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:43 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:08.386 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:08.436 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:08.437 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:08.437 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:08.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd 2023-11-01T03:10:09.038 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:44 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:09.128 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:10:09.178 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:09.179 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:10:09.179 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:09.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse 2023-11-01T03:10:09.793 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:44 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:09.934 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:09.935 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:09.935 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-11-01T03:10:09.935 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:09.936 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:09.936 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 85 k 2023-11-01T03:10:09.936 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:09.936 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:09.936 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:09.937 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:09.937 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:09.937 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 85 k 2023-11-01T03:10:09.937 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 227 k 2023-11-01T03:10:09.938 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:10.137 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-18.0.0-6776.g420cd129.el9.x86_64.rpm 423 kB/s | 85 kB 00:00 2023-11-01T03:10:10.138 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:10.138 INFO:teuthology.orchestra.run.smithi153.stdout:Total 420 kB/s | 85 kB 00:00 2023-11-01T03:10:10.138 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:10.145 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:10.145 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:10.199 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:10.199 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:10.335 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:10.435 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:10.854 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:11.200 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:11.200 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:11.411 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror 2023-11-01T03:10:11.963 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:46 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:12.109 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:12.111 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:12.111 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:10:12.111 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:12.112 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-01T03:10:12.112 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:12.112 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:12.113 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:12.113 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:12.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:12.113 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 3.0 M 2023-11-01T03:10:12.113 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 12 M 2023-11-01T03:10:12.114 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:12.506 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-18.0.0-6776.g420cd129.el9.x86_64.rpm 7.6 MB/s | 3.0 MB 00:00 2023-11-01T03:10:12.507 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:12.507 INFO:teuthology.orchestra.run.smithi153.stdout:Total 7.6 MB/s | 3.0 MB 00:00 2023-11-01T03:10:12.507 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:12.516 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:12.516 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:12.587 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:12.588 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:13.065 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:13.090 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:13.090 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-01T03:10:13.090 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-01T03:10:13.091 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-01T03:10:13.091 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-01T03:10:13.091 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:14.241 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:14.241 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:14.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:14.242 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:14.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd 2023-11-01T03:10:15.078 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:50 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:15.219 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:15.220 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:15.220 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-11-01T03:10:15.220 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:15.220 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:15.221 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 169 k 2023-11-01T03:10:15.221 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:15.221 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:15.221 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:15.221 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:15.222 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:15.222 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 169 k 2023-11-01T03:10:15.222 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 490 k 2023-11-01T03:10:15.222 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:15.442 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-18.0.0-6776.g420cd129.el9.x86_64.rpm 760 kB/s | 169 kB 00:00 2023-11-01T03:10:15.443 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:15.444 INFO:teuthology.orchestra.run.smithi153.stdout:Total 756 kB/s | 169 kB 00:00 2023-11-01T03:10:15.444 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:15.451 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:15.451 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:15.512 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:15.513 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:15.660 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:15.765 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:16.245 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:10:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:16.559 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:16.560 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:16.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base-debuginfo 2023-11-01T03:10:17.362 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:52 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:17.515 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:17.515 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:10:17.516 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:17.516 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:17.516 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 74 M 2023-11-01T03:10:17.517 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-11-01T03:10:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 21 M 2023-11-01T03:10:17.517 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:17.517 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:17.518 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:17.518 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2023-11-01T03:10:17.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:17.519 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 95 M 2023-11-01T03:10:17.520 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 515 M 2023-11-01T03:10:17.520 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:19.995 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): ceph-debuginfo-18.0.0-6776.g420cd129.el9 8.6 MB/s | 21 MB 00:02 2023-11-01T03:10:21.703 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): ceph-base-debuginfo-18.0.0-6776.g420cd12 18 MB/s | 74 MB 00:04 2023-11-01T03:10:21.705 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:21.706 INFO:teuthology.orchestra.run.smithi153.stdout:Total 23 MB/s | 95 MB 00:04 2023-11-01T03:10:21.706 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:21.711 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:21.711 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:10:25.343 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:10:33.046 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-01T03:10:33.120 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-01T03:10:34.093 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:10:34.663 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:10:36.563 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-01T03:10:36.564 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/2 2023-11-01T03:10:36.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-01T03:10:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:36.836 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:10:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:36.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:36.837 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:10:37.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-common-debuginfo 2023-11-01T03:10:37.632 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:03:12 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:10:37.776 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:10:37.777 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:10:37.777 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:37.777 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:10:37.777 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 408 M 2023-11-01T03:10:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:37.778 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:10:37.778 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:10:37.778 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:10:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:10:37.779 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 408 M 2023-11-01T03:10:37.779 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.6 G 2023-11-01T03:10:37.779 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:10:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:10:38.429 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:10:38.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:38.429 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:10:38.430 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:38.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:38.430 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:10:38.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-11-01T03:10:39.336 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:03:33 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:10:39.481 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:10:39.482 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:10:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:10:39.483 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:10:39.483 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:10:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.4 M 2023-11-01T03:10:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:39.483 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:10:39.484 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2023-11-01T03:10:39.484 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:10:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:39.484 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.4 M 2023-11-01T03:10:39.484 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 6.3 M 2023-11-01T03:10:39.485 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:10:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-immutable-object-cache-debuginfo-18.0.0-67 1.5 MB/s | 1.4 MB 00:00 2023-11-01T03:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.5 MB/s | 1.4 MB 00:00 2023-11-01T03:10:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:10:40.450 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:10:40.499 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:10:40.500 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:10:40.777 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:10:40.887 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:10:41.307 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:10:41.575 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:41.576 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:10:41.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw-debuginfo 2023-11-01T03:10:42.328 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:03:36 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:10:42.474 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:10:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:10:42.475 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:10:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:10:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:10:42.476 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 174 M 2023-11-01T03:10:42.476 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:10:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:10:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:10:42.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:10:42.477 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 174 M 2023-11-01T03:10:42.477 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 732 M 2023-11-01T03:10:42.477 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:10:55.973 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-common-debuginfo-18.0.0-6776.g420cd129.el9 22 MB/s | 408 MB 00:18 2023-11-01T03:10:55.974 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:10:55.974 INFO:teuthology.orchestra.run.smithi153.stdout:Total 22 MB/s | 408 MB 00:18 2023-11-01T03:10:55.974 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:10:55.978 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:10:55.978 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:10:58.415 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:10:58.416 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:11:10.387 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-radosgw-debuginfo-18.0.0-6776.g420cd129.el 6.2 MB/s | 174 MB 00:27 2023-11-01T03:11:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:11:10.388 INFO:teuthology.orchestra.run.smithi005.stdout:Total 6.2 MB/s | 174 MB 00:27 2023-11-01T03:11:10.389 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:11:10.392 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:11:10.393 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:11:11.501 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:11:11.501 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:11:30.332 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:11:30.435 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:11:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:11:35.276 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:11:35.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:11:35.277 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:11:35.277 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:11:35.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:11:35.278 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:11:35.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test-debuginfo 2023-11-01T03:11:36.052 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:04:30 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:11:36.199 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:11:36.200 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:11:36.201 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:11:36.201 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:11:36.201 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:11:36.201 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 630 M 2023-11-01T03:11:36.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:11:36.202 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:11:36.202 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:11:36.202 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:11:36.202 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:11:36.202 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 630 M 2023-11-01T03:11:36.203 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.8 G 2023-11-01T03:11:36.203 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:11:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:11:40.009 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:11:47.752 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:11:48.016 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:11:48.016 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:48.017 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:11:48.017 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:11:48.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:48.017 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:11:48.255 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-11-01T03:11:48.812 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:04:23 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:11:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:11:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:11:48.954 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:11:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:11:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:11:48.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.4 M 2023-11-01T03:11:48.955 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:11:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================== 2023-11-01T03:11:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:11:48.955 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.4 M 2023-11-01T03:11:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 6.3 M 2023-11-01T03:11:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:11:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-debuginfo-18.0.0-67 678 kB/s | 1.4 MB 00:02 2023-11-01T03:11:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:11:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:Total 677 kB/s | 1.4 MB 00:02 2023-11-01T03:11:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:11:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:11:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:11:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:11:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:11:51.440 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:11:51.544 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:11:51.967 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:11:52.232 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-01T03:11:52.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:52.233 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:11:52.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:11:52.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:52.234 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:11:52.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw-debuginfo 2023-11-01T03:11:52.966 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:04:27 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:11:53.107 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:11:53.108 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:11:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:11:53.108 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:11:53.108 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:11:53.108 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 174 M 2023-11-01T03:11:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:53.109 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:11:53.109 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:11:53.109 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:11:53.109 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:11:53.110 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 174 M 2023-11-01T03:11:53.110 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 732 M 2023-11-01T03:11:53.110 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:12:30.302 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-radosgw-debuginfo-18.0.0-6776.g420cd129.el 4.7 MB/s | 174 MB 00:37 2023-11-01T03:12:30.303 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:12:30.303 INFO:teuthology.orchestra.run.smithi153.stdout:Total 4.7 MB/s | 174 MB 00:37 2023-11-01T03:12:30.303 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:12:30.306 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:12:30.306 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:12:31.365 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:12:31.366 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:12:35.772 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-test-debuginfo-18.0.0-6776.g420cd129.el9.x 11 MB/s | 630 MB 00:59 2023-11-01T03:12:35.773 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:12:35.774 INFO:teuthology.orchestra.run.smithi005.stdout:Total 11 MB/s | 630 MB 00:59 2023-11-01T03:12:35.774 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:12:35.780 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:12:35.780 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:12:39.708 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:12:39.709 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:12:49.426 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:12:49.574 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:12:53.930 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:12:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-01T03:12:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:12:54.206 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:12:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:12:54.206 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:12:54.207 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:12:54.396 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test-debuginfo 2023-11-01T03:12:54.947 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:29 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:12:55.090 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:12:55.091 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:12:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:12:55.092 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:12:55.092 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:12:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 630 M 2023-11-01T03:12:55.092 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:12:55.093 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:12:55.093 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:12:55.093 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:12:55.093 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:12:55.093 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 630 M 2023-11-01T03:12:55.094 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.8 G 2023-11-01T03:12:55.094 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:13:23.774 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-test-debuginfo-18.0.0-6776.g420cd129.el9.x 22 MB/s | 630 MB 00:28 2023-11-01T03:13:23.775 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:13:23.775 INFO:teuthology.orchestra.run.smithi153.stdout:Total 22 MB/s | 630 MB 00:28 2023-11-01T03:13:23.775 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:13:23.780 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:13:23.781 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:13:27.534 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:13:27.534 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:13:49.539 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:13:50.111 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:13:58.086 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:13:58.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:13:58.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:13:58.354 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:13:58.354 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:13:58.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:13:58.355 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:13:58.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base-debuginfo 2023-11-01T03:13:59.212 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:06:53 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:13:59.306 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:13:59.359 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:13:59.360 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-11-01T03:13:59.361 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:13:59.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-debuginfo 2023-11-01T03:14:00.015 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:06:54 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:14:00.163 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:14:00.164 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:00.165 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:14:00.166 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:00.166 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:14:00.166 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:00.166 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 19 M 2023-11-01T03:14:00.166 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 101 M 2023-11-01T03:14:00.167 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:14:01.251 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-mgr-debuginfo-18.0.0-6776.g420cd129.el9.x8 18 MB/s | 19 MB 00:01 2023-11-01T03:14:01.252 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:14:01.253 INFO:teuthology.orchestra.run.smithi005.stdout:Total 18 MB/s | 19 MB 00:01 2023-11-01T03:14:01.253 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:14:01.257 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:14:01.258 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:14:01.413 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:14:01.414 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:14:03.727 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:14:03.836 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:04.802 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:05.088 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:14:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:14:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:05.089 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:14:05.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mds-debuginfo 2023-11-01T03:14:05.834 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:06:59 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:14:05.981 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:14:05.982 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:05.982 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:14:05.982 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:05.982 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:14:05.983 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 47 M 2023-11-01T03:14:05.983 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:05.983 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:14:05.983 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:05.983 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:14:05.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:05.984 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 47 M 2023-11-01T03:14:05.984 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 169 M 2023-11-01T03:14:05.984 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:14:15.220 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-mds-debuginfo-18.0.0-6776.g420cd129.el9.x8 5.1 MB/s | 47 MB 00:09 2023-11-01T03:14:15.221 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:14:15.222 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.1 MB/s | 47 MB 00:09 2023-11-01T03:14:15.222 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:14:15.226 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:14:15.227 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:14:15.552 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:14:15.553 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:14:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:14:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:21.941 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:22.224 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:22.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:22.224 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:14:22.225 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:14:22.225 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:22.225 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:14:22.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mon-debuginfo 2023-11-01T03:14:22.987 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:07:16 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:14:23.134 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:14:23.135 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:23.136 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:14:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:23.136 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:14:23.136 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 112 M 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:23.137 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 112 M 2023-11-01T03:14:23.138 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 508 M 2023-11-01T03:14:23.138 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:14:28.697 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-mon-debuginfo-18.0.0-6776.g420cd129.el9.x8 20 MB/s | 112 MB 00:05 2023-11-01T03:14:28.698 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:14:28.699 INFO:teuthology.orchestra.run.smithi005.stdout:Total 20 MB/s | 112 MB 00:05 2023-11-01T03:14:28.699 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:14:28.703 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:14:28.703 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:14:29.428 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:14:29.428 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:14:33.849 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:14:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:14:41.803 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:14:41.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:43.076 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:14:43.346 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:14:43.346 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:43.347 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:14:43.347 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:14:43.347 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:43.347 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:14:43.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base-debuginfo 2023-11-01T03:14:44.180 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:07:19 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:14:44.271 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-01T03:14:44.321 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:14:44.322 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-11-01T03:14:44.323 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:14:44.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-debuginfo 2023-11-01T03:14:44.934 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:07:19 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:14:45.076 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:14:45.077 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:45.077 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:14:45.077 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:45.077 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:14:45.077 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-01T03:14:45.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:45.078 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:14:45.078 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:45.078 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:14:45.078 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:45.079 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 19 M 2023-11-01T03:14:45.079 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 101 M 2023-11-01T03:14:45.079 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:14:45.125 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:45.403 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:45.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:45.403 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:14:45.404 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:14:45.404 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:45.404 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:14:45.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-osd-debuginfo 2023-11-01T03:14:46.129 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:07:40 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:14:46.258 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-mgr-debuginfo-18.0.0-6776.g420cd129.el9.x8 16 MB/s | 19 MB 00:01 2023-11-01T03:14:46.259 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:14:46.259 INFO:teuthology.orchestra.run.smithi153.stdout:Total 16 MB/s | 19 MB 00:01 2023-11-01T03:14:46.260 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:14:46.263 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:14:46.264 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:14:46.273 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:14:46.274 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:46.274 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:14:46.274 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:46.274 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:14:46.275 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 313 M 2023-11-01T03:14:46.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:46.275 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:14:46.275 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:14:46.275 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:14:46.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:14:46.276 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 313 M 2023-11-01T03:14:46.276 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.3 G 2023-11-01T03:14:46.276 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:14:46.409 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:14:46.410 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:14:48.592 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:14:48.739 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:49.658 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:14:49.928 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:14:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:14:49.929 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:14:50.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mds-debuginfo 2023-11-01T03:14:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:07:25 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:14:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:14:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:50.777 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:14:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:14:50.778 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 47 M 2023-11-01T03:14:50.778 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:14:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:14:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:14:50.779 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:14:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 47 M 2023-11-01T03:14:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 169 M 2023-11-01T03:14:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:15:02.009 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-mds-debuginfo-18.0.0-6776.g420cd129.el9.x8 4.2 MB/s | 47 MB 00:11 2023-11-01T03:15:02.010 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:02.010 INFO:teuthology.orchestra.run.smithi153.stdout:Total 4.2 MB/s | 47 MB 00:11 2023-11-01T03:15:02.011 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:15:02.015 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:15:02.015 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:15:02.323 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:15:02.324 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:15:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:15:07.131 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:08.456 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:08.672 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-osd-debuginfo-18.0.0-6776.g420cd129.el9.x8 14 MB/s | 313 MB 00:22 2023-11-01T03:15:08.672 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:08.673 INFO:teuthology.orchestra.run.smithi005.stdout:Total 14 MB/s | 313 MB 00:22 2023-11-01T03:15:08.673 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:15:08.677 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:15:08.678 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:15:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:08.724 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:08.724 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:15:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:15:08.725 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:08.725 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:15:08.920 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mon-debuginfo 2023-11-01T03:15:09.465 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:07:44 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:15:09.607 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:15:09.607 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:15:09.608 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:09.608 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:15:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 112 M 2023-11-01T03:15:09.608 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:15:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:15:09.609 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:09.609 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 112 M 2023-11-01T03:15:09.610 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 508 M 2023-11-01T03:15:09.610 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:15:10.642 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:15:10.642 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:15:14.803 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-mon-debuginfo-18.0.0-6776.g420cd129.el9.x8 22 MB/s | 112 MB 00:05 2023-11-01T03:15:14.803 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:14.804 INFO:teuthology.orchestra.run.smithi153.stdout:Total 22 MB/s | 112 MB 00:05 2023-11-01T03:15:14.804 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:15:14.808 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:15:14.808 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:15:15.501 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:15:15.502 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:15:27.528 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:15:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:31.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:31.112 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:31.112 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:15:31.113 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:15:31.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:31.113 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:15:31.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-osd-debuginfo 2023-11-01T03:15:31.837 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:08:06 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:15:31.976 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:15:31.977 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:31.978 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:15:31.978 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:31.978 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:15:31.978 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 313 M 2023-11-01T03:15:31.979 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:31.979 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:15:31.979 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:15:31.979 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:15:31.979 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:15:31.980 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 313 M 2023-11-01T03:15:31.980 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.3 G 2023-11-01T03:15:31.980 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:15:44.650 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:15:44.753 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:45.927 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-osd-debuginfo-18.0.0-6776.g420cd129.el9.x8 22 MB/s | 313 MB 00:13 2023-11-01T03:15:45.928 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:45.928 INFO:teuthology.orchestra.run.smithi153.stdout:Total 22 MB/s | 313 MB 00:13 2023-11-01T03:15:45.929 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:15:45.933 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:15:45.933 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:15:47.802 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:15:47.802 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:15:52.915 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:53.188 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:15:53.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:53.189 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:15:53.189 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:15:53.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:53.190 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:15:53.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse-debuginfo 2023-11-01T03:15:53.960 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:08:47 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:15:54.108 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:15:54.109 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.8 M 2023-11-01T03:15:54.110 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:54.110 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:15:54.110 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:54.110 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:15:54.110 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:54.111 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 5.8 M 2023-11-01T03:15:54.111 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 28 M 2023-11-01T03:15:54.111 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:15:55.146 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x 5.6 MB/s | 5.8 MB 00:01 2023-11-01T03:15:55.146 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:55.147 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.6 MB/s | 5.8 MB 00:01 2023-11-01T03:15:55.147 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:15:55.151 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:15:55.151 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:15:55.222 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:15:55.223 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:15:55.980 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:15:56.090 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:15:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:15:56.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:15:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:15:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:15:56.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:56.955 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:15:57.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados-devel-debuginfo 2023-11-01T03:15:57.686 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:08:51 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:15:57.833 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:15:57.834 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:57.834 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:15:57.834 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:57.834 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:15:57.835 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 108 k 2023-11-01T03:15:57.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:57.835 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:15:57.835 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:57.835 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:15:57.836 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:57.836 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 108 k 2023-11-01T03:15:57.836 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 440 k 2023-11-01T03:15:57.836 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:15:58.082 INFO:teuthology.orchestra.run.smithi005.stdout:librados-devel-debuginfo-18.0.0-6776.g420cd129. 438 kB/s | 108 kB 00:00 2023-11-01T03:15:58.083 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:15:58.083 INFO:teuthology.orchestra.run.smithi005.stdout:Total 436 kB/s | 108 kB 00:00 2023-11-01T03:15:58.083 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:15:58.086 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:15:58.087 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:15:58.122 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:15:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:15:58.239 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:15:58.358 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:15:58.692 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:15:58.963 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:15:58.963 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:58.964 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:15:58.964 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:15:58.964 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:58.964 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:15:59.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2-debuginfo 2023-11-01T03:15:59.709 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:08:53 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:15:59.866 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:15:59.867 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:59.867 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:15:59.867 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:59.867 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:15:59.867 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.1 M 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:15:59.868 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 5.1 M 2023-11-01T03:15:59.869 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 24 M 2023-11-01T03:15:59.869 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:00.577 INFO:teuthology.orchestra.run.smithi005.stdout:libcephfs2-debuginfo-18.0.0-6776.g420cd129.el9. 7.3 MB/s | 5.1 MB 00:00 2023-11-01T03:16:00.577 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:00.578 INFO:teuthology.orchestra.run.smithi005.stdout:Total 7.2 MB/s | 5.1 MB 00:00 2023-11-01T03:16:00.578 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:00.581 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:00.582 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:00.648 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:00.649 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:01.330 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:01.429 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:01.948 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:02.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:02.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:02.231 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:02.231 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:02.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:02.231 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:02.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2-debuginfo 2023-11-01T03:16:02.995 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:08:56 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:03.140 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:03.141 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:03.141 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:03.141 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:03.141 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:03.141 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 44 M 2023-11-01T03:16:03.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:03.142 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:03.142 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:03.142 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:03.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:03.143 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 44 M 2023-11-01T03:16:03.143 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 251 M 2023-11-01T03:16:03.143 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:05.471 INFO:teuthology.orchestra.run.smithi005.stdout:librados2-debuginfo-18.0.0-6776.g420cd129.el9.x 19 MB/s | 44 MB 00:02 2023-11-01T03:16:05.472 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:05.472 INFO:teuthology.orchestra.run.smithi005.stdout:Total 19 MB/s | 44 MB 00:02 2023-11-01T03:16:05.473 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:05.477 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:05.477 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:05.796 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:05.796 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:13.094 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:13.352 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:13.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:13.352 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:13.352 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:13.353 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:13.353 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:13.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1-debuginfo 2023-11-01T03:16:14.122 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:08 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:14.269 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:14.270 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:14.271 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:14.271 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:14.271 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:14.271 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-01T03:16:14.271 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:14.272 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:14.272 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:14.272 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:14.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:14.273 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 51 M 2023-11-01T03:16:14.273 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 298 M 2023-11-01T03:16:14.273 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:16.715 INFO:teuthology.orchestra.run.smithi005.stdout:librbd1-debuginfo-18.0.0-6776.g420cd129.el9.x86 21 MB/s | 51 MB 00:02 2023-11-01T03:16:16.716 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:16.717 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 51 MB 00:02 2023-11-01T03:16:16.717 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:16.721 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:16.721 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:17.080 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:17.080 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:19.972 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:20.146 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:23.262 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:23.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:25.801 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:25.801 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:26.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-cephfs-debuginfo 2023-11-01T03:16:26.579 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:20 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:26.724 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:26.725 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:26.725 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:26.725 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 615 k 2023-11-01T03:16:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:26.726 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:26.726 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:26.726 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:26.727 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 615 k 2023-11-01T03:16:26.727 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.1 M 2023-11-01T03:16:26.727 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:27.018 INFO:teuthology.orchestra.run.smithi005.stdout:python3-cephfs-debuginfo-18.0.0-6776.g420cd129. 2.1 MB/s | 615 kB 00:00 2023-11-01T03:16:27.019 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:27.019 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.0 MB/s | 615 kB 00:00 2023-11-01T03:16:27.020 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:27.023 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:27.023 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:27.062 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:27.063 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:27.344 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:28.040 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:28.041 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:28.058 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:28.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rados-debuginfo 2023-11-01T03:16:28.336 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:28.336 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:28.336 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:28.336 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:28.337 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:28.337 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:28.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse-debuginfo 2023-11-01T03:16:28.803 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:22 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:28.949 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:28.950 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:28.950 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 770 k 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:28.951 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:28.952 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 770 k 2023-11-01T03:16:28.952 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.7 M 2023-11-01T03:16:28.952 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:29.099 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:04 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:29.238 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:29.240 INFO:teuthology.orchestra.run.smithi005.stdout:python3-rados-debuginfo-18.0.0-6776.g420cd129.e 2.6 MB/s | 770 kB 00:00 2023-11-01T03:16:29.240 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:29.240 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.6 MB/s | 770 kB 00:00 2023-11-01T03:16:29.240 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:29.241 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:29.241 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:29.241 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:29.241 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:29.241 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.8 M 2023-11-01T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:29.242 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:29.243 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 5.8 M 2023-11-01T03:16:29.243 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 28 M 2023-11-01T03:16:29.243 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:16:29.244 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:29.244 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:29.284 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:29.284 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:29.473 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:29.590 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:16:29.758 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x 11 MB/s | 5.8 MB 00:00 2023-11-01T03:16:29.763 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:29.763 INFO:teuthology.orchestra.run.smithi153.stdout:Total 11 MB/s | 5.8 MB 00:00 2023-11-01T03:16:29.764 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:16:29.764 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:16:29.764 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:16:29.831 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:16:29.832 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:16:30.007 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:16:30.284 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:16:30.284 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:30.284 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:30.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:30.285 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:30.285 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:30.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rbd-debuginfo 2023-11-01T03:16:30.657 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:31.175 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:25 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:31.223 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:31.320 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:31.321 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:31.321 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:31.321 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:31.321 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:31.322 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.1 M 2023-11-01T03:16:31.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:31.322 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:31.322 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:31.322 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:31.323 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:31.323 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.1 M 2023-11-01T03:16:31.323 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 4.3 M 2023-11-01T03:16:31.323 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:31.487 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:31.487 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:31.488 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:31.488 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:31.488 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:31.488 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:31.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel-debuginfo 2023-11-01T03:16:31.666 INFO:teuthology.orchestra.run.smithi005.stdout:python3-rbd-debuginfo-18.0.0-6776.g420cd129.el9 3.3 MB/s | 1.1 MB 00:00 2023-11-01T03:16:31.667 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:31.668 INFO:teuthology.orchestra.run.smithi005.stdout:Total 3.2 MB/s | 1.1 MB 00:00 2023-11-01T03:16:31.668 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:31.671 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:31.671 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:31.713 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:31.713 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:31.943 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:32.051 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:32.195 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:07 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:32.334 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:32.335 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:32.335 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:32.335 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:32.336 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 108 k 2023-11-01T03:16:32.336 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:32.336 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:32.336 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:32.337 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:32.337 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:32.337 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 108 k 2023-11-01T03:16:32.337 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 440 k 2023-11-01T03:16:32.337 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:16:32.453 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:32.544 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-debuginfo-18.0.0-6776.g420cd129. 520 kB/s | 108 kB 00:00 2023-11-01T03:16:32.545 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:32.545 INFO:teuthology.orchestra.run.smithi153.stdout:Total 516 kB/s | 108 kB 00:00 2023-11-01T03:16:32.546 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:16:32.548 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:16:32.549 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:16:32.582 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:16:32.583 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:16:32.694 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:32.723 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:32.724 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:32.724 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:32.724 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:32.724 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:32.725 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:32.800 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:32.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rgw-debuginfo 2023-11-01T03:16:33.199 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:33.469 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:16:33.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:33.470 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:33.470 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:33.470 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:33.470 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:33.496 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:27 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:33.641 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:33.642 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:33.643 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:33.643 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:33.643 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:33.643 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 337 k 2023-11-01T03:16:33.643 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:33.644 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:33.644 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:33.644 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:33.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:33.644 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 337 k 2023-11-01T03:16:33.645 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.0 M 2023-11-01T03:16:33.645 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:33.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2-debuginfo 2023-11-01T03:16:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:python3-rgw-debuginfo-18.0.0-6776.g420cd129.el9 1.3 MB/s | 337 kB 00:00 2023-11-01T03:16:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.3 MB/s | 337 kB 00:00 2023-11-01T03:16:33.905 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:33.908 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:33.908 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:33.945 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:33.946 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:34.091 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:34.205 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:09 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:34.346 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:34.347 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:34.347 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:34.347 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:34.348 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.1 M 2023-11-01T03:16:34.348 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:34.348 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:34.349 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:34.349 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:34.349 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:34.349 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 5.1 M 2023-11-01T03:16:34.349 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 24 M 2023-11-01T03:16:34.350 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:16:34.572 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:34.839 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs2-debuginfo-18.0.0-6776.g420cd129.el9. 10 MB/s | 5.1 MB 00:00 2023-11-01T03:16:34.840 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:34.840 INFO:teuthology.orchestra.run.smithi153.stdout:Total 10 MB/s | 5.1 MB 00:00 2023-11-01T03:16:34.840 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:16:34.843 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:16:34.844 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:16:34.857 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:16:34.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:34.858 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:34.858 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:34.858 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:34.858 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:34.906 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:16:34.906 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:16:35.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse-debuginfo 2023-11-01T03:16:35.554 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:35.609 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:29 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:35.646 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:35.757 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:35.758 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:35.758 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:35.758 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 506 k 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:35.759 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:35.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:35.760 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 506 k 2023-11-01T03:16:35.760 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.5 M 2023-11-01T03:16:35.761 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:36.040 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x8 1.8 MB/s | 506 kB 00:00 2023-11-01T03:16:36.041 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:36.042 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.7 MB/s | 506 kB 00:00 2023-11-01T03:16:36.042 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:36.045 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:36.045 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:36.083 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:36.084 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:36.164 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:36.247 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:36.433 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:36.434 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:36.434 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:36.434 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:36.434 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:36.434 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:36.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2-debuginfo 2023-11-01T03:16:36.742 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:37.007 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:16:37.007 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:37.008 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:37.008 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:37.009 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:37.009 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:37.150 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:12 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:37.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-mirror-debuginfo 2023-11-01T03:16:37.289 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:37.290 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:37.291 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:37.291 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:37.291 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:37.291 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 44 M 2023-11-01T03:16:37.291 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:37.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 44 M 2023-11-01T03:16:37.293 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 251 M 2023-11-01T03:16:37.293 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:16:37.755 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:31 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:37.907 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:37.908 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:37.909 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:37.909 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:37.909 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:37.910 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-01T03:16:37.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:37.911 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:37.911 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:37.911 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:37.912 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:37.912 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 51 M 2023-11-01T03:16:37.912 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 289 M 2023-11-01T03:16:37.913 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:39.458 INFO:teuthology.orchestra.run.smithi153.stdout:librados2-debuginfo-18.0.0-6776.g420cd129.el9.x 20 MB/s | 44 MB 00:02 2023-11-01T03:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:39.459 INFO:teuthology.orchestra.run.smithi153.stdout:Total 20 MB/s | 44 MB 00:02 2023-11-01T03:16:39.460 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:16:39.463 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:16:39.464 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:16:39.764 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:16:39.765 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:16:44.791 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:44.872 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:46.746 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:47.009 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-mirror-debuginfo-18.0.0-6776.g420cd129.el9. 5.6 MB/s | 51 MB 00:09 2023-11-01T03:16:47.010 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:47.011 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.6 MB/s | 51 MB 00:09 2023-11-01T03:16:47.011 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:47.015 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:47.015 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:47.024 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-01T03:16:47.024 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:47.024 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:47.024 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:47.025 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:47.025 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:47.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1-debuginfo 2023-11-01T03:16:47.365 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:47.365 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:47.757 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:22 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:47.898 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:47.899 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:47.899 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:47.900 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:47.901 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:47.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:47.901 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 51 M 2023-11-01T03:16:47.901 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 298 M 2023-11-01T03:16:47.901 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:16:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:librbd1-debuginfo-18.0.0-6776.g420cd129.el9.x86 21 MB/s | 51 MB 00:02 2023-11-01T03:16:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:Total 21 MB/s | 51 MB 00:02 2023-11-01T03:16:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:16:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:16:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:16:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:16:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:16:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:53.576 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:55.697 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:55.979 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:16:55.979 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:55.979 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:55.980 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:55.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:55.980 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:56.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-nbd-debuginfo 2023-11-01T03:16:56.526 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:16:56.633 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:56.867 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:09:50 ago on Wed 01 Nov 2023 03:07:06 AM UTC. 2023-11-01T03:16:57.015 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-11-01T03:16:57.015 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:57.016 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2023-11-01T03:16:57.016 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:57.016 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-11-01T03:16:57.016 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.2 M 2023-11-01T03:16:57.016 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-11-01T03:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-11-01T03:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2023-11-01T03:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:57.017 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.2 M 2023-11-01T03:16:57.018 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 5.4 M 2023-11-01T03:16:57.018 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-11-01T03:16:57.336 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-nbd-debuginfo-18.0.0-6776.g420cd129.el9.x86 3.9 MB/s | 1.2 MB 00:00 2023-11-01T03:16:57.338 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:16:57.338 INFO:teuthology.orchestra.run.smithi005.stdout:Total 3.8 MB/s | 1.2 MB 00:00 2023-11-01T03:16:57.338 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-11-01T03:16:57.341 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-11-01T03:16:57.341 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-11-01T03:16:57.384 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-11-01T03:16:57.385 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-11-01T03:16:57.631 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-11-01T03:16:57.738 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:58.172 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:58.446 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-11-01T03:16:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:16:58.446 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-11-01T03:16:58.609 DEBUG:teuthology.parallel:result is None 2023-11-01T03:16:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:58.965 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:16:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:58.966 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:16:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:16:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:58.966 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:16:59.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs-debuginfo 2023-11-01T03:16:59.715 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:34 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:16:59.856 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:16:59.856 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:59.856 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:16:59.857 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:59.857 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:16:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 615 k 2023-11-01T03:16:59.857 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:59.857 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:16:59.858 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:16:59.858 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:16:59.858 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:16:59.858 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 615 k 2023-11-01T03:16:59.858 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.1 M 2023-11-01T03:16:59.859 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:00.138 INFO:teuthology.orchestra.run.smithi153.stdout:python3-cephfs-debuginfo-18.0.0-6776.g420cd129. 2.1 MB/s | 615 kB 00:00 2023-11-01T03:17:00.139 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:00.139 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.1 MB/s | 615 kB 00:00 2023-11-01T03:17:00.139 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:00.142 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:00.142 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:00.180 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:00.180 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:00.349 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:00.463 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:17:00.887 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:17:01.182 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-01T03:17:01.182 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:01.182 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:01.182 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:01.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:01.183 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:01.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados-debuginfo 2023-11-01T03:17:01.922 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:36 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:02.061 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:02.062 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:02.062 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:02.062 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:02.063 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:02.063 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 770 k 2023-11-01T03:17:02.063 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:02.063 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:02.063 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:02.064 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 770 k 2023-11-01T03:17:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.7 M 2023-11-01T03:17:02.064 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:02.332 INFO:teuthology.orchestra.run.smithi153.stdout:python3-rados-debuginfo-18.0.0-6776.g420cd129.e 2.8 MB/s | 770 kB 00:00 2023-11-01T03:17:02.333 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:02.333 INFO:teuthology.orchestra.run.smithi153.stdout:Total 2.8 MB/s | 770 kB 00:00 2023-11-01T03:17:02.333 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:02.336 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:02.337 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:02.374 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:02.375 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:02.557 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:02.672 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:17:03.091 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:17:03.382 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-01T03:17:03.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:03.383 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:03.383 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:03.383 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:03.383 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:03.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd-debuginfo 2023-11-01T03:17:04.131 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:39 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:04.272 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:04.273 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:04.273 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:04.273 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:04.273 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.1 M 2023-11-01T03:17:04.274 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:04.274 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:04.274 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:04.274 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:04.275 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:04.275 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.1 M 2023-11-01T03:17:04.275 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 4.3 M 2023-11-01T03:17:04.275 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:04.618 INFO:teuthology.orchestra.run.smithi153.stdout:python3-rbd-debuginfo-18.0.0-6776.g420cd129.el9 3.3 MB/s | 1.1 MB 00:00 2023-11-01T03:17:04.619 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:04.619 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.3 MB/s | 1.1 MB 00:00 2023-11-01T03:17:04.620 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:04.623 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:04.623 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:04.662 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:04.662 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:04.875 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:04.966 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:05.391 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:05.664 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:05.664 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:05.664 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:05.665 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:05.665 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:05.665 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:05.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw-debuginfo 2023-11-01T03:17:06.418 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:41 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:06.557 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:06.559 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:06.559 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:06.559 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:06.559 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:06.559 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 337 k 2023-11-01T03:17:06.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:06.560 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:06.560 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:06.560 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:06.560 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:06.561 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 337 k 2023-11-01T03:17:06.561 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.0 M 2023-11-01T03:17:06.561 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:06.805 INFO:teuthology.orchestra.run.smithi153.stdout:python3-rgw-debuginfo-18.0.0-6776.g420cd129.el9 1.3 MB/s | 337 kB 00:00 2023-11-01T03:17:06.805 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:06.805 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.3 MB/s | 337 kB 00:00 2023-11-01T03:17:06.806 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:06.809 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:06.809 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:06.843 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:06.843 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:07.078 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:07.449 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-01T03:17:07.729 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:07.729 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:07.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:07.730 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:07.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse-debuginfo 2023-11-01T03:17:08.481 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:43 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:08.621 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:08.622 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:08.622 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:08.622 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:08.622 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 506 k 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:08.623 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 506 k 2023-11-01T03:17:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.5 M 2023-11-01T03:17:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:08.900 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x8 1.8 MB/s | 506 kB 00:00 2023-11-01T03:17:08.901 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:08.901 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.8 MB/s | 506 kB 00:00 2023-11-01T03:17:08.901 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:08.904 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:08.904 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:08.939 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:08.939 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:09.199 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:17:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:17:09.879 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-01T03:17:09.879 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:09.880 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:09.880 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:09.880 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:09.880 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:10.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror-debuginfo 2023-11-01T03:17:10.600 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:45 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:10.741 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:10.742 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:10.742 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:10.742 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:10.742 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:10.743 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-01T03:17:10.743 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:10.743 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:10.743 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:10.743 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:10.744 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:10.744 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 51 M 2023-11-01T03:17:10.744 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 289 M 2023-11-01T03:17:10.744 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:13.186 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-debuginfo-18.0.0-6776.g420cd129.el9. 21 MB/s | 51 MB 00:02 2023-11-01T03:17:13.187 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:13.187 INFO:teuthology.orchestra.run.smithi153.stdout:Total 21 MB/s | 51 MB 00:02 2023-11-01T03:17:13.188 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:13.191 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:13.192 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:13.524 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:13.524 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:19.333 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:19.425 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:17:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:17:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-01T03:17:21.688 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:21.688 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:21.689 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:21.689 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:21.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd-debuginfo 2023-11-01T03:17:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:09:57 ago on Wed 01 Nov 2023 03:07:25 AM UTC. 2023-11-01T03:17:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-11-01T03:17:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:22.575 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-11-01T03:17:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-11-01T03:17:22.576 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.2 M 2023-11-01T03:17:22.576 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-11-01T03:17:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-11-01T03:17:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-11-01T03:17:22.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.2 M 2023-11-01T03:17:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 5.4 M 2023-11-01T03:17:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-11-01T03:17:22.896 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-debuginfo-18.0.0-6776.g420cd129.el9.x86 3.9 MB/s | 1.2 MB 00:00 2023-11-01T03:17:22.896 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-11-01T03:17:22.897 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.8 MB/s | 1.2 MB 00:00 2023-11-01T03:17:22.897 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-11-01T03:17:22.900 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-11-01T03:17:22.900 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-11-01T03:17:22.940 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-11-01T03:17:22.941 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-11-01T03:17:23.174 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-11-01T03:17:23.279 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:17:23.709 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:17:23.987 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-01T03:17:23.987 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:23.987 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-11-01T03:17:23.987 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-01T03:17:23.988 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:23.988 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-11-01T03:17:24.162 DEBUG:teuthology.parallel:result is None 2023-11-01T03:17:24.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:17:24.308 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-01T03:17:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-6776.g420cd129.el9 2023-11-01T03:17:24.334 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6776.g420cd129.el9 2023-11-01T03:17:24.335 INFO:teuthology.task.install:The correct ceph version 18.0.0-6776.g420cd129 is installed. 2023-11-01T03:17:24.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:17:24.508 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-01T03:17:24.530 INFO:teuthology.orchestra.run.smithi153.stdout:18.0.0-6776.g420cd129.el9 2023-11-01T03:17:24.530 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6776.g420cd129.el9 2023-11-01T03:17:24.530 INFO:teuthology.task.install:The correct ceph version 18.0.0-6776.g420cd129 is installed. 2023-11-01T03:17:24.531 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-01T03:17:24.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:24.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-01T03:17:24.568 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:24.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-01T03:17:24.596 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-01T03:17:24.597 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:24.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-11-01T03:17:24.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-01T03:17:24.714 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:24.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-11-01T03:17:24.741 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-01T03:17:24.808 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-01T03:17:24.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:24.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-01T03:17:24.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-01T03:17:24.915 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:24.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-01T03:17:24.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-01T03:17:25.009 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-01T03:17:25.010 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:25.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-11-01T03:17:25.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-01T03:17:25.116 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:25.117 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-11-01T03:17:25.143 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-01T03:17:25.210 INFO:teuthology.run_tasks:Running task ceph... 2023-11-01T03:17:25.270 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-01T03:17:25.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-11-01T03:17:25.273 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-11-01T03:17:25.303 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-01T03:17:25.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-01T03:17:25.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-01T03:17:25.376 INFO:tasks.ceph:Creating extra log directories... 2023-11-01T03:17:25.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-01T03:17:25.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-01T03:17:25.457 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-01T03:17:25.458 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-01T03:17:25.458 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457', 'branch': 'DBG_maintain_prefix_itr_2', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7442457', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'DBG_maintain_prefix_itr_2'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'DBG_maintain_prefix_itr_2', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}}, 'owner': 'scheduled_benhanokh@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9009, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'DBG_maintain_prefix_itr_2', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEny+pvqlar+v530FdjsCfFT6WNVxnjZiEVDNl9tHCurGg35izLFzLw88y+c+P3NZYCEgtxJxtZeOnQVxRzVlKI=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSe1wvYgaRTWfJC1wmfL/tBooUp9AYWKvs7s/AVlyEmGvFKrKtBLRkOlu6DZgxX95h8uMJ4T0yKOE+i2J8t/P8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-10-31_16:51:39', 'tube': 'smithi', 'user': 'benhanokh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.770726'} 2023-11-01T03:17:25.459 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-01T03:17:25.491 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-01T03:17:25.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-11-01T03:17:25.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-11-01T03:17:25.576 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:25.576 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-11-01T03:17:25.632 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-01T03:17:25.633 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-11-01T03:17:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-01T03:17:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:25.688 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-11-01T03:17:25.688 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:25.689 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:25.689 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-01 03:08:54.572159696 +0000 2023-11-01T03:17:25.689 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-01 03:06:22.930757437 +0000 2023-11-01T03:17:25.689 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-01 03:06:22.930757437 +0000 2023-11-01T03:17:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-01 03:06:22.930757437 +0000 2023-11-01T03:17:25.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-01T03:17:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-01T03:17:25.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-01T03:17:25.757 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 7.9782e-05 s, 6.4 MB/s 2023-11-01T03:17:25.758 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-01T03:17:25.813 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-11-01T03:17:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-01T03:17:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:25.869 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-11-01T03:17:25.869 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:25.869 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:25.869 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-01 03:08:54.572159696 +0000 2023-11-01T03:17:25.870 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-01 03:06:23.418747285 +0000 2023-11-01T03:17:25.870 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-01 03:06:23.418747285 +0000 2023-11-01T03:17:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-01 03:06:23.418747285 +0000 2023-11-01T03:17:25.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-01T03:17:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-01T03:17:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-01T03:17:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.8805e-05 s, 5.2 MB/s 2023-11-01T03:17:25.938 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-01T03:17:25.994 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-11-01T03:17:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-01T03:17:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.053 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-01T03:17:26.053 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.053 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.053 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-01 03:08:54.573159675 +0000 2023-11-01T03:17:26.053 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-01 03:06:23.901737237 +0000 2023-11-01T03:17:26.054 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-01 03:06:23.901737237 +0000 2023-11-01T03:17:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-01 03:06:23.901737237 +0000 2023-11-01T03:17:26.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-01T03:17:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-01T03:17:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-01T03:17:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.3263e-05 s, 5.5 MB/s 2023-11-01T03:17:26.123 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-01T03:17:26.178 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-11-01T03:17:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-01T03:17:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.234 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-01T03:17:26.234 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.234 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.234 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-11-01 03:08:54.573159675 +0000 2023-11-01T03:17:26.234 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-11-01 03:06:24.378727313 +0000 2023-11-01T03:17:26.235 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-11-01 03:06:24.378727313 +0000 2023-11-01T03:17:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-11-01 03:06:24.378727313 +0000 2023-11-01T03:17:26.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-01T03:17:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-11-01T03:17:26.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-11-01T03:17:26.303 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.7748e-05 s, 5.2 MB/s 2023-11-01T03:17:26.303 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-01T03:17:26.359 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:26.359 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:26.359 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-11-01T03:17:26.377 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-01T03:17:26.377 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-11-01T03:17:26.433 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-01T03:17:26.433 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.433 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-01T03:17:26.434 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.434 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.434 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-01 03:10:13.336944679 +0000 2023-11-01T03:17:26.434 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-01 03:06:15.662884384 +0000 2023-11-01T03:17:26.435 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-01 03:06:15.662884384 +0000 2023-11-01T03:17:26.435 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2023-11-01 03:06:15.662884384 +0000 2023-11-01T03:17:26.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-01T03:17:26.501 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-01T03:17:26.502 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-01T03:17:26.502 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000218079 s, 2.3 MB/s 2023-11-01T03:17:26.503 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-01T03:17:26.560 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-11-01T03:17:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-01T03:17:26.615 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.615 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-01T03:17:26.616 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.616 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.616 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-01 03:10:13.336944679 +0000 2023-11-01T03:17:26.616 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-01 03:06:16.146876146 +0000 2023-11-01T03:17:26.616 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-01 03:06:16.146876146 +0000 2023-11-01T03:17:26.617 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2023-11-01 03:06:16.146876146 +0000 2023-11-01T03:17:26.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-01T03:17:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-01T03:17:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-01T03:17:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000202399 s, 2.5 MB/s 2023-11-01T03:17:26.683 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-01T03:17:26.739 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-11-01T03:17:26.795 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-01T03:17:26.795 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.795 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-01T03:17:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-01 03:10:13.336944679 +0000 2023-11-01T03:17:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-01 03:06:16.628867942 +0000 2023-11-01T03:17:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-01 03:06:16.628867942 +0000 2023-11-01T03:17:26.797 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2023-11-01 03:06:16.628867942 +0000 2023-11-01T03:17:26.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-01T03:17:26.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-01T03:17:26.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-01T03:17:26.861 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000189067 s, 2.7 MB/s 2023-11-01T03:17:26.862 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-01T03:17:26.918 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-11-01T03:17:26.973 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-01T03:17:26.973 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-01T03:17:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-01T03:17:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-01T03:17:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-11-01T03:17:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-11-01 03:10:13.337944662 +0000 2023-11-01T03:17:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-11-01 03:06:17.107859789 +0000 2023-11-01T03:17:26.975 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-11-01 03:06:17.107859789 +0000 2023-11-01T03:17:26.975 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2023-11-01 03:06:17.107859789 +0000 2023-11-01T03:17:26.975 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-01T03:17:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-11-01T03:17:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-11-01T03:17:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000228071 s, 2.2 MB/s 2023-11-01T03:17:27.040 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-01T03:17:27.096 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:27.096 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-01T03:17:27.096 INFO:tasks.ceph:Generating config... 2023-11-01T03:17:27.098 INFO:tasks.ceph:[client] debug monc = 20 2023-11-01T03:17:27.098 INFO:tasks.ceph:[client] debug ms = 1 2023-11-01T03:17:27.098 INFO:tasks.ceph:[client] debug objecter = 20 2023-11-01T03:17:27.099 INFO:tasks.ceph:[client] debug rados = 20 2023-11-01T03:17:27.099 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-11-01T03:17:27.099 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-11-01T03:17:27.101 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-11-01T03:17:27.101 INFO:tasks.ceph:[global] ms type = async 2023-11-01T03:17:27.102 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2023-11-01T03:17:27.102 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-01T03:17:27.102 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-01T03:17:27.103 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-01T03:17:27.103 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-01T03:17:27.103 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-01T03:17:27.103 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-11-01T03:17:27.104 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-11-01T03:17:27.104 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-11-01T03:17:27.104 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-11-01T03:17:27.104 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-11-01T03:17:27.105 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-11-01T03:17:27.105 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-11-01T03:17:27.105 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-11-01T03:17:27.105 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-01T03:17:27.106 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-01T03:17:27.106 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-01T03:17:27.106 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-01T03:17:27.106 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-01T03:17:27.107 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-11-01T03:17:27.107 INFO:tasks.ceph:[osd] debug bluefs = 1 2023-11-01T03:17:27.107 INFO:tasks.ceph:[osd] debug bluestore = 1 2023-11-01T03:17:27.107 INFO:tasks.ceph:[osd] debug monc = 20 2023-11-01T03:17:27.108 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-01T03:17:27.108 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-01T03:17:27.108 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-01T03:17:27.108 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-01T03:17:27.109 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-01T03:17:27.109 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-01T03:17:27.109 INFO:tasks.ceph:[osd] osd class default list = * 2023-11-01T03:17:27.109 INFO:tasks.ceph:[osd] osd class load list = * 2023-11-01T03:17:27.110 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2023-11-01T03:17:27.110 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-11-01T03:17:27.110 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-11-01T03:17:27.110 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-01T03:17:27.111 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-11-01T03:17:27.111 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-11-01T03:17:27.111 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2023-11-01T03:17:27.112 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-01T03:17:27.112 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-11-01T03:17:27.112 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-11-01T03:17:27.112 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-01T03:17:27.112 INFO:tasks.ceph:Setting up mon.a... 2023-11-01T03:17:27.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-01T03:17:27.177 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-11-01T03:17:27.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-01T03:17:27.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-01T03:17:27.263 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.c', '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]'), ('mon.b', '172.21.15.153')] 2023-11-01T03:17:27.264 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.153', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-11-01T03:17:27.265 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:27.265 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-01T03:17:27.320 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --addv c '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]' --add b 172.21.15.153 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:27.405 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:27.405 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:17:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-11-01T03:17:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-11-01T03:17:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:17:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:17:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:17:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-11-01T03:17:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-11-01T03:17:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:17:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:17:27.407 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:17:27.408 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-01T03:17:27.409 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-01T03:17:27.424 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32... 2023-11-01T03:17:27.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-01T03:17:27.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-01T03:17:27.517 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-11-01T03:17:27.517 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-11-01T03:17:27.517 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-01T03:17:27.517 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-11-01T03:17:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-11-01T03:17:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-11-01T03:17:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.519 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-11-01T03:17:27.519 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-11-01T03:17:27.519 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.519 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-11-01T03:17:27.519 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-11-01T03:17:27.520 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.520 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-01T03:17:27.520 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-11-01T03:17:27.520 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.520 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-11-01T03:17:27.521 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-01T03:17:27.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.521 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-11-01T03:17:27.521 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.522 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-11-01T03:17:27.522 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-11-01T03:17:27.522 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-11-01T03:17:27.522 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-11-01T03:17:27.522 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-11-01T03:17:27.523 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-11-01T03:17:27.523 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-11-01T03:17:27.523 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-01T03:17:27.523 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-01T03:17:27.523 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-11-01T03:17:27.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.524 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-01T03:17:27.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.524 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-11-01T03:17:27.525 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.525 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-11-01T03:17:27.525 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.525 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-11-01T03:17:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-11-01T03:17:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-11-01T03:17:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.153" 2023-11-01T03:17:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2023-11-01T03:17:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: mon election default strategy = 1 2023-11-01T03:17:27.527 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 5000 2023-11-01T03:17:27.527 INFO:teuthology.orchestra.run.smithi153.stdout: ms type = async 2023-11-01T03:17:27.527 INFO:teuthology.orchestra.run.smithi153.stdout: osd heartbeat grace = 80 2023-11-01T03:17:27.527 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:17:27.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.528 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-11-01T03:17:27.528 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-11-01T03:17:27.528 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.528 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-11-01T03:17:27.528 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-11-01T03:17:27.529 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-11-01T03:17:27.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.529 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-11-01T03:17:27.529 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-11-01T03:17:27.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-11-01T03:17:27.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-11-01T03:17:27.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-11-01T03:17:27.530 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2023-11-01T03:17:27.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-11-01T03:17:27.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-11-01T03:17:27.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.531 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-11-01T03:17:27.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-11-01T03:17:27.532 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-11-01T03:17:27.533 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.533 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-11-01T03:17:27.533 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-11-01T03:17:27.533 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-11-01T03:17:27.533 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-11-01T03:17:27.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-11-01T03:17:27.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-11-01T03:17:27.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-11-01T03:17:27.534 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore zero block detection = True 2023-11-01T03:17:27.534 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1 2023-11-01T03:17:27.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1 2023-11-01T03:17:27.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug monc = 20 2023-11-01T03:17:27.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-01T03:17:27.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-11-01T03:17:27.535 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2023-11-01T03:17:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-11-01T03:17:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-11-01T03:17:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-11-01T03:17:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: osd class default list = * 2023-11-01T03:17:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: osd class load list = * 2023-11-01T03:17:27.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd client watch timeout = 120 2023-11-01T03:17:27.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify cached snaps = True 2023-11-01T03:17:27.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify missing on start = True 2023-11-01T03:17:27.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-11-01T03:17:27.537 INFO:teuthology.orchestra.run.smithi153.stdout: osd fast shutdown = False 2023-11-01T03:17:27.538 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock override recovery settings = True 2023-11-01T03:17:27.538 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-11-01T03:17:27.538 INFO:teuthology.orchestra.run.smithi153.stdout: osd op queue = debug_random 2023-11-01T03:17:27.538 INFO:teuthology.orchestra.run.smithi153.stdout: osd op queue cut off = debug_random 2023-11-01T03:17:27.538 INFO:teuthology.orchestra.run.smithi153.stdout: osd shutdown pgref assert = True 2023-11-01T03:17:27.539 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.539 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-11-01T03:17:27.539 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-01T03:17:27.539 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-11-01T03:17:27.539 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-11-01T03:17:27.540 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-11-01T03:17:27.540 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-11-01T03:17:27.540 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-11-01T03:17:27.540 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-11-01T03:17:27.540 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.541 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-11-01T03:17:27.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-01T03:17:27.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-11-01T03:17:27.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-11-01T03:17:27.541 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-11-01T03:17:27.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-11-01T03:17:27.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-11-01T03:17:27.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-11-01T03:17:27.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-11-01T03:17:27.542 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-11-01T03:17:27.543 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-11-01T03:17:27.543 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.543 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-01T03:17:27.543 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-11-01T03:17:27.543 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.544 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-11-01T03:17:27.545 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-11-01T03:17:27.545 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.545 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-11-01T03:17:27.545 INFO:teuthology.orchestra.run.smithi153.stdout: mon min osdmap epochs = 50 2023-11-01T03:17:27.545 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd crush smoke test = False 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: mon osdmap full prune interval = 2 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: mon osdmap full prune min = 15 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: mon osdmap full prune txsize = 2 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: mon scrub interval = 300 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on pool no app = False 2023-11-01T03:17:27.546 INFO:teuthology.orchestra.run.smithi153.stdout: paxos service trim min = 10 2023-11-01T03:17:27.547 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-01T03:17:27.547 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-11-01T03:17:27.547 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-11-01T03:17:27.547 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-11-01T03:17:27.547 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: debug monc = 20 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: debug objecter = 20 2023-11-01T03:17:27.548 INFO:teuthology.orchestra.run.smithi153.stdout: debug rados = 20 2023-11-01T03:17:27.549 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-11-01T03:17:27.549 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-11-01T03:17:27.549 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-11-01T03:17:27.550 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-11-01T03:17:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-11-01T03:17:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-01T03:17:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-11-01T03:17:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-11-01T03:17:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-11-01T03:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-11-01T03:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-11-01T03:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-01T03:17:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-11-01T03:17:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-11-01T03:17:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-01T03:17:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-11-01T03:17:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-11-01T03:17:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-11-01T03:17:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-11-01T03:17:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-11-01T03:17:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-11-01T03:17:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-11-01T03:17:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-11-01T03:17:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-01T03:17:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-01T03:17:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-11-01T03:17:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-01T03:17:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-11-01T03:17:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-11-01T03:17:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-11-01T03:17:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-11-01T03:17:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-11-01T03:17:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.153" 2023-11-01T03:17:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: mon client directed command retry = 5 2023-11-01T03:17:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: mon election default strategy = 1 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject socket failures = 5000 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: ms type = async 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: osd heartbeat grace = 80 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.560 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-11-01T03:17:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-11-01T03:17:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-11-01T03:17:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-11-01T03:17:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2023-11-01T03:17:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-11-01T03:17:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-11-01T03:17:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-11-01T03:17:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-11-01T03:17:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-11-01T03:17:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2023-11-01T03:17:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-11-01T03:17:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-11-01T03:17:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-11-01T03:17:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-11-01T03:17:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-11-01T03:17:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-11-01T03:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-11-01T03:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-11-01T03:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-11-01T03:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore zero block detection = True 2023-11-01T03:17:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1 2023-11-01T03:17:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1 2023-11-01T03:17:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: debug monc = 20 2023-11-01T03:17:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-01T03:17:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: osd class default list = * 2023-11-01T03:17:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: osd class load list = * 2023-11-01T03:17:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: osd client watch timeout = 120 2023-11-01T03:17:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify cached snaps = True 2023-11-01T03:17:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify missing on start = True 2023-11-01T03:17:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd fast shutdown = False 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock override recovery settings = True 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd op queue = debug_random 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd op queue cut off = debug_random 2023-11-01T03:17:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: osd shutdown pgref assert = True 2023-11-01T03:17:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.572 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-11-01T03:17:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-01T03:17:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-11-01T03:17:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-11-01T03:17:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-11-01T03:17:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-11-01T03:17:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-11-01T03:17:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-11-01T03:17:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.574 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-11-01T03:17:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-01T03:17:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-11-01T03:17:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-11-01T03:17:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-11-01T03:17:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-11-01T03:17:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-11-01T03:17:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-11-01T03:17:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-11-01T03:17:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-11-01T03:17:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-11-01T03:17:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-01T03:17:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-11-01T03:17:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-11-01T03:17:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-11-01T03:17:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-11-01T03:17:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: mon min osdmap epochs = 50 2023-11-01T03:17:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd crush smoke test = False 2023-11-01T03:17:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune interval = 2 2023-11-01T03:17:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune min = 15 2023-11-01T03:17:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune txsize = 2 2023-11-01T03:17:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: mon scrub interval = 300 2023-11-01T03:17:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: paxos service trim min = 10 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-11-01T03:17:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-11-01T03:17:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-01T03:17:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-01T03:17:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: debug monc = 20 2023-11-01T03:17:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-11-01T03:17:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: debug objecter = 20 2023-11-01T03:17:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: debug rados = 20 2023-11-01T03:17:27.582 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-11-01T03:17:27.582 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-11-01T03:17:27.582 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-11-01T03:17:27.583 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-01T03:17:27.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-01T03:17:27.650 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-01T03:17:27.651 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:27.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-01T03:17:27.666 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:27.667 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-01T03:17:27.721 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:17:27.722 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:27.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-01T03:17:27.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-01T03:17:27.807 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:27.808 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:27.863 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:17:27.863 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:27.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-01T03:17:27.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-01T03:17:27.903 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:27.904 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:27.958 INFO:tasks.ceph:Setting up mon nodes... 2023-11-01T03:17:27.959 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-01T03:17:27.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-01T03:17:28.021 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-01T03:17:28.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-01T03:17:28.085 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-01T03:17:28.088 INFO:tasks.ceph:Setting up mds nodes... 2023-11-01T03:17:28.088 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-01T03:17:28.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-01T03:17:28.135 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-01T03:17:28.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-01T03:17:28.195 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-01T03:17:28.210 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-01T03:17:28.211 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-01T03:17:28.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-01T03:17:28.241 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:28.242 INFO:tasks.ceph:role: osd.0 2023-11-01T03:17:28.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:17:28.243 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-01T03:17:28.311 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:28.312 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:28.313 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:28.313 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:28.313 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:28.344 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-01T03:17:28.346 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-01T03:17:28.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-01T03:17:28.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-01T03:17:28.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-01T03:17:28.567 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:28.568 INFO:tasks.ceph:role: osd.1 2023-11-01T03:17:28.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:17:28.568 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-01T03:17:28.637 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:28.638 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:28.639 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:28.639 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:28.639 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:28.639 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:28.639 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:28.670 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-01T03:17:28.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-01T03:17:28.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-01T03:17:28.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-01T03:17:28.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-01T03:17:28.892 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:28.892 INFO:tasks.ceph:role: osd.2 2023-11-01T03:17:28.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:17:28.893 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-01T03:17:28.962 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:28.963 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:28.964 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:28.964 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:28.964 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:28.994 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-01T03:17:28.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-01T03:17:28.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-01T03:17:29.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-01T03:17:29.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-01T03:17:29.216 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:29.216 INFO:tasks.ceph:role: osd.3 2023-11-01T03:17:29.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:17:29.217 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-01T03:17:29.286 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:29.286 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:29.287 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:29.319 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-11-01T03:17:29.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-11-01T03:17:29.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-01T03:17:29.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-01T03:17:29.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.568+0000 7faf6980e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-01T03:17:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.569+0000 7faf6980e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-01T03:17:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.569+0000 7faf6980e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-01T03:17:29.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.569+0000 7faf6980e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-01T03:17:29.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.569+0000 7faf6980e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-01T03:17:29.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:29.569+0000 7faf6980e500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-01T03:17:32.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-01T03:17:32.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.539+0000 7f6ec5aab500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-01T03:17:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.539+0000 7f6ec5aab500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-01T03:17:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.539+0000 7f6ec5aab500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-01T03:17:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.539+0000 7f6ec5aab500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-01T03:17:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.539+0000 7f6ec5aab500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-01T03:17:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:32.540+0000 7f6ec5aab500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-01T03:17:35.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-01T03:17:35.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.513+0000 7f896079b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-01T03:17:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.514+0000 7f896079b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-01T03:17:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.514+0000 7f896079b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-01T03:17:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.514+0000 7f896079b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-01T03:17:35.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.514+0000 7f896079b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-01T03:17:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:35.514+0000 7f896079b500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-01T03:17:38.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-01T03:17:38.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-01T03:17:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-01T03:17:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-01T03:17:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-01T03:17:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-01T03:17:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:38.491+0000 7fabefc24500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-01T03:17:41.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-01T03:17:41.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-01T03:17:41.405 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:41.405 INFO:tasks.ceph:role: osd.4 2023-11-01T03:17:41.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:17:41.405 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-01T03:17:41.483 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:41.483 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:41.483 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:41.483 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:41.484 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:41.484 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:41.484 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:41.484 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:41.484 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:41.485 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:41.996 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-01T03:17:41.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-01T03:17:41.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-01T03:17:42.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-01T03:17:42.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-01T03:17:42.256 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:42.257 INFO:tasks.ceph:role: osd.5 2023-11-01T03:17:42.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:17:42.257 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-01T03:17:42.333 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:42.333 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:42.333 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:42.333 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:42.334 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:42.818 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-01T03:17:42.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-01T03:17:42.820 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-01T03:17:42.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-01T03:17:42.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-01T03:17:43.019 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:43.019 INFO:tasks.ceph:role: osd.6 2023-11-01T03:17:43.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:17:43.020 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-01T03:17:43.094 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:43.094 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:43.095 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:43.096 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:43.096 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:43.618 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-01T03:17:43.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-01T03:17:43.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-01T03:17:43.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-01T03:17:43.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-01T03:17:43.868 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-01T03:17:43.869 INFO:tasks.ceph:role: osd.7 2023-11-01T03:17:43.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:17:43.869 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-01T03:17:43.942 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-01T03:17:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-01T03:17:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-01T03:17:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-01T03:17:43.943 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-01T03:17:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-11-01T03:17:43.944 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-01T03:17:43.944 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-01T03:17:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-01T03:17:43.944 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-01T03:17:44.465 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-11-01T03:17:44.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-11-01T03:17:44.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-01T03:17:44.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-01T03:17:44.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:44.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.734+0000 7fab3ca25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-01T03:17:44.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.735+0000 7fab3ca25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-01T03:17:44.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.735+0000 7fab3ca25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-01T03:17:44.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.735+0000 7fab3ca25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-01T03:17:44.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.735+0000 7fab3ca25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-01T03:17:44.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:44.735+0000 7fab3ca25500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-01T03:17:47.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-01T03:17:47.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:47.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.699+0000 7f252e210500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-01T03:17:47.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.699+0000 7f252e210500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-01T03:17:47.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.699+0000 7f252e210500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-01T03:17:47.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.699+0000 7f252e210500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-01T03:17:47.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.699+0000 7f252e210500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-01T03:17:47.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:47.700+0000 7f252e210500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-01T03:17:50.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-01T03:17:50.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:50.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.661+0000 7fb4d9210500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-01T03:17:50.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.661+0000 7fb4d9210500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-01T03:17:50.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.661+0000 7fb4d9210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-01T03:17:50.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.662+0000 7fb4d9210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-01T03:17:50.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.662+0000 7fb4d9210500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-01T03:17:50.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:50.662+0000 7fb4d9210500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-01T03:17:53.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-01T03:17:53.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:53.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.627+0000 7f4dc6218500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-01T03:17:53.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.628+0000 7f4dc6218500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-01T03:17:53.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.628+0000 7f4dc6218500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-01T03:17:53.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.628+0000 7f4dc6218500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-01T03:17:53.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.628+0000 7f4dc6218500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-01T03:17:53.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:17:53.628+0000 7f4dc6218500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-01T03:17:56.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-01T03:17:56.509 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-01T03:17:56.509 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:56.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-01T03:17:56.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:56.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-01T03:17:56.620 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:56.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-01T03:17:56.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:56.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-01T03:17:56.766 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:56.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-01T03:17:56.839 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:56.839 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-01T03:17:56.871 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:56.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-01T03:17:56.943 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:56.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-01T03:17:57.015 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:57.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-01T03:17:57.084 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:57.084 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-01T03:17:57.153 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:17:57.154 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-01T03:17:57.171 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:17:57.171 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-01T03:17:57.209 INFO:tasks.ceph:Adding keys to all mons... 2023-11-01T03:17:57.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-01T03:17:57.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-01T03:17:57.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-11-01T03:17:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBIw0FlzqhGARAA+x945/S7jHfCLzugluRLyg== 2023-11-01T03:17:57.254 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-11-01T03:17:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBJw0Fl7ST4IRAAdpXbyhkq2HVatuj7lPmw3A== 2023-11-01T03:17:57.254 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-11-01T03:17:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBMw0FlA+U2IBAA8hClnjmPNYFKEMDg9H+YBA== 2023-11-01T03:17:57.254 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-11-01T03:17:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBPw0FlCLGuHhAA4YP79he2hs5CAQLN9pGWaw== 2023-11-01T03:17:57.255 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-11-01T03:17:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBSw0FlQSVYHRAAlZoZJSp7kQIeBKUkQrd/gw== 2023-11-01T03:17:57.255 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-11-01T03:17:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBIw0FlXcQhBRAAbx+RObzLq484DF8rJJWCbg== 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBYw0FlL6DbKxAAdzDX2q6gKm/w3a4d6EzErQ== 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBbw0Flz3e9KRAAkz5R+voVQ4Vagt7VWwhouw== 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-11-01T03:17:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBew0FlQeh/JxAAXrpN5OOTwvmHX2Ut720GAA== 2023-11-01T03:17:57.257 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-11-01T03:17:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBhw0Flmdd7JRAAC9jWMSeHS4P93eSrCFQm2A== 2023-11-01T03:17:57.257 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-11-01T03:17:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBIw0FlCX8WCBAA31g11+uefa0AK7mZpn/jaA== 2023-11-01T03:17:57.257 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-11-01T03:17:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBIw0FlTE2vCxAAyPJ6Y4SiYAhAd2PjARjllg== 2023-11-01T03:17:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2023-11-01T03:17:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBIw0FlzqhGARAA+x945/S7jHfCLzugluRLyg== 2023-11-01T03:17:57.277 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2023-11-01T03:17:57.277 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBJw0Fl7ST4IRAAdpXbyhkq2HVatuj7lPmw3A== 2023-11-01T03:17:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2023-11-01T03:17:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBMw0FlA+U2IBAA8hClnjmPNYFKEMDg9H+YBA== 2023-11-01T03:17:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2023-11-01T03:17:57.278 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBPw0FlCLGuHhAA4YP79he2hs5CAQLN9pGWaw== 2023-11-01T03:17:57.278 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2023-11-01T03:17:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBSw0FlQSVYHRAAlZoZJSp7kQIeBKUkQrd/gw== 2023-11-01T03:17:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2023-11-01T03:17:57.279 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBIw0FlXcQhBRAAbx+RObzLq484DF8rJJWCbg== 2023-11-01T03:17:57.279 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBYw0FlL6DbKxAAdzDX2q6gKm/w3a4d6EzErQ== 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBbw0Flz3e9KRAAkz5R+voVQ4Vagt7VWwhouw== 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBew0FlQeh/JxAAXrpN5OOTwvmHX2Ut720GAA== 2023-11-01T03:17:57.280 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2023-11-01T03:17:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBhw0Flmdd7JRAAC9jWMSeHS4P93eSrCFQm2A== 2023-11-01T03:17:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-11-01T03:17:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBIw0FlCX8WCBAA31g11+uefa0AK7mZpn/jaA== 2023-11-01T03:17:57.281 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2023-11-01T03:17:57.281 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBIw0FlTE2vCxAAyPJ6Y4SiYAhAd2PjARjllg== 2023-11-01T03:17:57.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-01T03:17:57.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-01T03:17:57.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.437 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-01T03:17:57.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-01T03:17:57.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-01T03:17:57.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-01T03:17:57.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-01T03:17:57.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-01T03:17:57.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-01T03:17:58.000 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-01T03:17:58.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-01T03:17:58.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-01T03:17:58.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-01T03:17:58.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-01T03:17:58.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-01T03:17:58.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-01T03:17:58.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-01T03:17:58.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-01T03:17:58.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-01T03:17:58.518 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:58.520 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-01T03:17:58.572 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-01T03:17:58.572 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-01T03:17:58.573 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-01T03:17:58.573 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-11-01T03:17:58.576 INFO:tasks.ceph.mon.a:Started 2023-11-01T03:17:58.576 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-01T03:17:58.576 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-01T03:17:58.577 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-11-01T03:17:58.579 INFO:tasks.ceph.mon.c:Started 2023-11-01T03:17:58.579 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-01T03:17:58.580 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-01T03:17:58.580 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-11-01T03:17:58.614 INFO:tasks.ceph.mon.b:Started 2023-11-01T03:17:58.614 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-01T03:17:58.615 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-01T03:17:58.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-11-01T03:17:58.617 INFO:tasks.ceph.mgr.y:Started 2023-11-01T03:17:58.618 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-01T03:17:58.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-11-01T03:17:58.620 INFO:tasks.ceph.mgr.x:Started 2023-11-01T03:17:58.620 INFO:tasks.ceph:Setting crush tunables to default 2023-11-01T03:17:58.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-11-01T03:17:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.726+0000 7fc5a2bd7640 10 monclient: get_monmap_and_config 2023-11-01T03:17:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.726+0000 7fc5a2bd7640 10 monclient: build_initial_monmap 2023-11-01T03:17:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.726+0000 7fc5a2bd7640 10 monclient: monmap: 2023-11-01T03:17:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:17:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:17:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:58.727608+0000 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:58.727608+0000 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:17:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:17:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:17:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:17:58.730 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:17:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.727+0000 7fc5a2bd7640 1 Processor -- start 2023-11-01T03:17:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.727+0000 7fc5a2bd7640 1 -- start start 2023-11-01T03:17:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.727+0000 7fc5a2bd7640 10 monclient: init 2023-11-01T03:17:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient: _reopen_session rank -1 2023-11-01T03:17:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2023-11-01T03:17:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc59c0a8b30 addr v1:172.21.15.5:6789/0 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-a con 0x7fc59c13f170 addr v2:172.21.15.5:3300/0 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc59c141c60 addr v1:172.21.15.153:6789/0 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c13f5c0 con 0x7fc59c0a8b30 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0b1670 con 0x7fc59c141c60 2023-11-01T03:17:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:17:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc59c13f170 2023-11-01T03:17:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): _renew_subs 2023-11-01T03:17:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a2bd7640 10 monclient(hunting): authenticate will time out at 1354.952166s 2023-11-01T03:17:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a0973640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc59c13ea60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:17:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc59bfff640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 msgr2=0x7fc59c0a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:17:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc59bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:17:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.728+0000 7fc5a1174640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fc59c141c60 legacy=0x7fc59c1420f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2023-11-01T03:17:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.929+0000 7fc5a0973640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc59c13ea60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:17:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.929+0000 7fc59bfff640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 msgr2=0x7fc59c0a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:17:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.929+0000 7fc59bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:17:58.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:58.929+0000 7fc5a1174640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fc59c141c60 legacy=0x7fc59c1420f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2023-11-01T03:17:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:59.330+0000 7fc5a0973640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc59c13ea60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:17:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:59.330+0000 7fc59bfff640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 msgr2=0x7fc59c0a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:17:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:59.330+0000 7fc59bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:17:59.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:17:59.330+0000 7fc5a1174640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fc59c141c60 legacy=0x7fc59c1420f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2023-11-01T03:18:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:00.131+0000 7fc5a0973640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc59c13ea60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:18:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:00.131+0000 7fc59bfff640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 msgr2=0x7fc59c0a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:18:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:00.131+0000 7fc59bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:00.131+0000 7fc5a1174640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fc59c141c60 legacy=0x7fc59c1420f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2023-11-01T03:18:01.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): tick 2023-11-01T03:18:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): _check_auth_tickets 2023-11-01T03:18:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 monclient(hunting): continuing hunt 2023-11-01T03:18:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): _reopen_session rank -1 2023-11-01T03:18:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 msgr2=0x7fc59c0a8f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc59c13f170 0x7fc59c0a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fc59c141c60 legacy=0x7fc59c1420f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc59c13ea60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient: _add_conns ranks=[4,2] 2023-11-01T03:18:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fc580003690 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fc580006100 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc580003690 2023-11-01T03:18:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc580008ca0 con 0x7fc580006100 2023-11-01T03:18:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59a7fc640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59bfff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 msgr2=0x7fc5800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.728+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.929+0000 7fc59bfff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 msgr2=0x7fc5800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.929+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.929+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:01.929+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:02.330+0000 7fc59bfff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 msgr2=0x7fc5800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:02.330+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:02.330+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:02.330+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:03.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:03.131+0000 7fc59bfff640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 msgr2=0x7fc5800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:03.131+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:03.131+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:03.131+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): tick 2023-11-01T03:18:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): _check_auth_tickets 2023-11-01T03:18:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 monclient(hunting): continuing hunt 2023-11-01T03:18:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): _reopen_session rank -1 2023-11-01T03:18:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 msgr2=0x7fc5800085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580006100 0x7fc5800085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2023-11-01T03:18:04.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc5a1174640 1 -- reap_dead start 2023-11-01T03:18:04.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:04.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fc580003690 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:04.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc59c0a8b30 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:04.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:04.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fc5800065b0 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:04.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0b80e0 con 0x7fc59c0a8b30 2023-11-01T03:18:04.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:04.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc5800065b0 2023-11-01T03:18:04.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580008ca0 con 0x7fc580003690 2023-11-01T03:18:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59a7fc640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc59bfff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc58000af30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:18:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc5a1174640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 msgr2=0x7fc58000c670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:18:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.728+0000 7fc5a1174640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.929+0000 7fc59bfff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc58000af30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:18:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.929+0000 7fc5a1174640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 msgr2=0x7fc58000c670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:18:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.929+0000 7fc5a1174640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.929+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:04.929+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:05.330+0000 7fc59bfff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc58000af30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:18:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:05.330+0000 7fc5a1174640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 msgr2=0x7fc58000c670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:18:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:05.330+0000 7fc5a1174640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:05.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:05.330+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:05.330+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:06.131+0000 7fc59bfff640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc58000af30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.5:6789/0 2023-11-01T03:18:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:06.131+0000 7fc5a1174640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 msgr2=0x7fc58000c670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3300/0 2023-11-01T03:18:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:06.131+0000 7fc5a1174640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:06.131+0000 7fc5a0973640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2023-11-01T03:18:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:06.131+0000 7fc5a0973640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:06.229 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:00:07.499 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:06.546 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:00:07.817 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:06.803 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:00:08.113 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:06.810 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:00:08.119 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:07.137 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:00:08.446 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:07.142 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:00:08.452 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:18:07.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): tick 2023-11-01T03:18:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): _check_auth_tickets 2023-11-01T03:18:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 monclient(hunting): continuing hunt 2023-11-01T03:18:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): _reopen_session rank -1 2023-11-01T03:18:07.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 msgr2=0x7fc580005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc580003690 0x7fc580005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 -- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 msgr2=0x7fc58000c670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5800065b0 0x7fc58000c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 -- >> v1:172.21.15.5:6789/0 conn(0x7fc59c0a8b30 legacy=0x7fc58000af30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient: _add_conns ranks=[2,1] 2023-11-01T03:18:07.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:07.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fc58000cc40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:07.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc58000d690 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:07.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c13f5c0 con 0x7fc58000d690 2023-11-01T03:18:07.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:07.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc58000cc40 2023-11-01T03:18:07.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc59a7fc640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:07.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc5a0973640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:07.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.728+0000 7fc5a0973640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.929+0000 7fc5a0973640 1 -- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:07.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.929+0000 7fc5a0973640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.962+0000 7fc59bfff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 0x7fc580011d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:35620/0 (socket says 172.21.15.5:35620) 2023-11-01T03:18:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:07.962+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 learned_addr learned my addr 172.21.15.5:0/2410676309 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:18:08.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.117+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 legacy=0x7fc580011d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-11-01T03:18:08.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.117+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 legacy=0x7fc580011d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-01T03:18:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.117+0000 7fc59bfff640 1 --1- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 0x7fc580011d80 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2023-11-01T03:18:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.117+0000 7fc59bfff640 1 --1- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 0x7fc580011d80 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2023-11-01T03:18:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.117+0000 7fc59b7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.153:6789/0 2023-11-01T03:18:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.330+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.5:3301/0 2023-11-01T03:18:08.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:08.330+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.131+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc58000cc40 auth_method 0 2023-11-01T03:18:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:09.132+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): tick 2023-11-01T03:18:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): _check_auth_tickets 2023-11-01T03:18:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 monclient(hunting): continuing hunt 2023-11-01T03:18:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): _reopen_session rank -1 2023-11-01T03:18:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc58000cc40 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 -- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000d690 legacy=0x7fc580011d80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-01T03:18:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 reap_dead start 2023-11-01T03:18:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2023-11-01T03:18:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fc580003690 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc58000b660 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fc580005b40 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 -- 172.21.15.5:0/2410676309 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0b80e0 con 0x7fc58000b660 2023-11-01T03:18:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 -- 172.21.15.5:0/2410676309 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc580005b40 2023-11-01T03:18:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 1 -- 172.21.15.5:0/2410676309 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc580008ca0 con 0x7fc580003690 2023-11-01T03:18:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.728+0000 7fc59a7fc640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.729+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.729+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc580003690 auth_method 0 2023-11-01T03:18:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.729+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.729+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.729+0000 7fc5a0973640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.730+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.730+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.730+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.730+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.931+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:10.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.931+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc580003690 auth_method 0 2023-11-01T03:18:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.931+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.931+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:10.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.931+0000 7fc5a0973640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.932+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.932+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.932+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:10.932+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.061+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.082+0000 7fc5a1174640 10 monclient(hunting): get_auth_request con 0x7fc580005b40 auth_method 0 2023-11-01T03:18:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.082+0000 7fc5a1174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.082+0000 7fc5a1174640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.082+0000 7fc5a1174640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.106+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-01T03:18:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.106+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.106+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.106+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.327+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.328+0000 7fc5a1174640 10 monclient(hunting): get_auth_request con 0x7fc580005b40 auth_method 0 2023-11-01T03:18:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.328+0000 7fc5a1174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.328+0000 7fc5a1174640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.328+0000 7fc5a1174640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.330+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.330+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.330+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.330+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-01T03:18:11.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.335+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.336+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc580003690 auth_method 0 2023-11-01T03:18:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.336+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.336+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.336+0000 7fc5a0973640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.337+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.337+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.337+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.337+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.817+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.925+0000 7fc5a1174640 10 monclient(hunting): get_auth_request con 0x7fc580005b40 auth_method 0 2023-11-01T03:18:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.925+0000 7fc5a1174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.925+0000 7fc5a1174640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:11.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.925+0000 7fc5a1174640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:11.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.936+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.936+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.936+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:11.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:11.936+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-01T03:18:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.139+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.140+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc580003690 auth_method 0 2023-11-01T03:18:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.140+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.140+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.140+0000 7fc5a0973640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.141+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-01T03:18:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.141+0000 7fc5a0973640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-01T03:18:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.141+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.141+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-01T03:18:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563877970 0 0) 0x7fc59c0b80e0 con 0x7fc58000b660 2023-11-01T03:18:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 10 monclient(hunting): _negotiate 2023-11-01T03:18:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 10 monclient(hunting): my global_id is 4102 2023-11-01T03:18:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.311+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58c003520 con 0x7fc58000b660 2023-11-01T03:18:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163497800 0 0) 0x7fc58c003520 con 0x7fc58000b660 2023-11-01T03:18:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58000d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58000d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 msgr2=0x7fc58000c1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-01T03:18:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 --2- 172.21.15.5:0/2410676309 >> v2:172.21.15.5:3300/0 conn(0x7fc580005b40 0x7fc58000c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 1 monclient: found mon.noname-c-legacy 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.425+0000 7fc59b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.153:6789/0 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0b1670 con 0x7fc58000b660 2023-11-01T03:18:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: _finish_auth 0 2023-11-01T03:18:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:18:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1534536980 0 0) 0x7fc588003e80 con 0x7fc58000b660 2023-11-01T03:18:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc5a2bd7640 5 monclient: authenticate success, global_id 4102 2023-11-01T03:18:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc5a2bd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2023-11-01T03:18:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: dump: 2023-11-01T03:18:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] but i'm connected to v1:172.21.15.153:6789/0, reconnecting 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 >> v1:172.21.15.153:6789/0 conn(0x7fc58000b660 legacy=0x7fc58000baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:18:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): picked mon.c con 0x7fc580003690 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c003fa0 0x7fc58c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): picked mon.a con 0x7fc58c003fa0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c004d00 0x7fc58c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): picked mon.b con 0x7fc58c004d00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0aa420 con 0x7fc58c003fa0 2023-11-01T03:18:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580008ca0 con 0x7fc58c004d00 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c00bbf0 con 0x7fc580003690 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc59b7fe640 10 monclient(hunting): _finish_auth 0 2023-11-01T03:18:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.426+0000 7fc5a2bd7640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.434+0000 7fc59bfff640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c003fa0 0x7fc58c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.435+0000 7fc59bfff640 10 monclient(hunting): get_auth_request con 0x7fc58c003fa0 auth_method 0 2023-11-01T03:18:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.435+0000 7fc59bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.435+0000 7fc59bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.435+0000 7fc59bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.437+0000 7fc59bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.437+0000 7fc59bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.437+0000 7fc59bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-01T03:18:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.439+0000 7fc5a1174640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c004d00 0x7fc58c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.447+0000 7fc5a0973640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.448+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc580003690 auth_method 0 2023-11-01T03:18:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.448+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.448+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.448+0000 7fc5a0973640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:18:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.449+0000 7fc5a0973640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.449+0000 7fc5a0973640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.449+0000 7fc5a0973640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-01T03:18:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 10 monclient(hunting): handle_auth_done global_id 4102 payload 293 2023-11-01T03:18:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 msgr2=0x7fc58c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc580003690 0x7fc58c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c004d00 msgr2=0x7fc58c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c004d00 0x7fc58c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 10 monclient: _finish_hunting 0 2023-11-01T03:18:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 1 monclient: found mon.a 2023-11-01T03:18:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.450+0000 7fc59bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.451+0000 7fc59bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.451+0000 7fc59bfff640 1 -- 172.21.15.5:0/2410676309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c003520 con 0x7fc58c003fa0 2023-11-01T03:18:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.451+0000 7fc59bfff640 10 monclient: _finish_auth 0 2023-11-01T03:18:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.451+0000 7fc59bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.451+0000 7fc59bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.468+0000 7fc59bfff640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c003fa0 0x7fc58c0047c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc58c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4016d7a8372bedd server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004bf0 con 0x7fc58c003fa0 2023-11-01T03:18:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: dump: 2023-11-01T03:18:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:12.490 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588004d70 con 0x7fc58c003fa0 2023-11-01T03:18:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 1 -- 172.21.15.5:0/2410676309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588007310 con 0x7fc58c003fa0 2023-11-01T03:18:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 4 set_mon_vals no callback set 2023-11-01T03:18:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc59b7fe640 10 monclient: dump: 2023-11-01T03:18:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:12.494 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 10 monclient: shutdown 2023-11-01T03:18:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c003fa0 msgr2=0x7fc58c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.487+0000 7fc5a2bd7640 1 --2- 172.21.15.5:0/2410676309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc58c003fa0 0x7fc58c0047c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc58c0057f0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a1174640 1 -- 172.21.15.5:0/2410676309 reap_dead start 2023-11-01T03:18:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/2410676309 shutdown_connections 2023-11-01T03:18:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/2410676309 >> 172.21.15.5:0/2410676309 conn(0x7fc59c0b7230 msgr2=0x7fc59c0b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/2410676309 shutdown_connections 2023-11-01T03:18:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/2410676309 wait complete. 2023-11-01T03:18:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 10 monclient: build_initial_monmap 2023-11-01T03:18:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.488+0000 7fc5a2bd7640 10 monclient: monmap: 2023-11-01T03:18:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:18:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:18:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 librados: starting msgr at 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 librados: starting objecter 2023-11-01T03:18:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 Processor -- start 2023-11-01T03:18:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 -- start start 2023-11-01T03:18:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 librados: setting wanted keys 2023-11-01T03:18:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 1 librados: calling monclient init 2023-11-01T03:18:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.489+0000 7fc5a2bd7640 10 monclient: init 2023-11-01T03:18:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c003fa0 0x7fc59c13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-b con 0x7fc58c003fa0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59c144a30 0x7fc59c1383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-a con 0x7fc59c144a30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): picked mon.noname-c con 0x7fc59c138920 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1442f0 con 0x7fc59c144a30 2023-11-01T03:18:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c145270 con 0x7fc58c003fa0 2023-11-01T03:18:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c138da0 con 0x7fc59c138920 2023-11-01T03:18:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.490+0000 7fc5a2bd7640 10 monclient(hunting): authenticate will time out at 1368.714300s 2023-11-01T03:18:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.504+0000 7fc5a1174640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59818/0 (socket says 172.21.15.5:59818) 2023-11-01T03:18:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 1 -- 172.21.15.5:0/1270030354 learned_addr learned my addr 172.21.15.5:0/1270030354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 10 monclient(hunting): get_auth_request con 0x7fc59c138920 auth_method 0 2023-11-01T03:18:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.505+0000 7fc5a1174640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.517+0000 7fc5a1174640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.517+0000 7fc5a1174640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.517+0000 7fc5a1174640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.527+0000 7fc5a0973640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c003fa0 0x7fc59c13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.528+0000 7fc5a0973640 10 monclient(hunting): get_auth_request con 0x7fc58c003fa0 auth_method 0 2023-11-01T03:18:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.528+0000 7fc5a0973640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.528+0000 7fc5a0973640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.528+0000 7fc5a0973640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 10 monclient(hunting): handle_auth_done global_id 4100 payload 824 2023-11-01T03:18:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 -- 172.21.15.5:0/1270030354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c003fa0 msgr2=0x7fc59c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c003fa0 0x7fc59c13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 -- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59c144a30 msgr2=0x7fc59c1383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59c144a30 0x7fc59c1383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 10 monclient: _finish_hunting 0 2023-11-01T03:18:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 monclient: found mon.noname-c 2023-11-01T03:18:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:12.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:18:12.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.530+0000 7fc5a1174640 1 -- 172.21.15.5:0/1270030354 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c13aea0 con 0x7fc59c138920 2023-11-01T03:18:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.535+0000 7fc5a1174640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0a8650 tx=0x7fc5940087c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.535+0000 7fc5997fa640 10 client.?.objecter ms_handle_connect 0x7fc59c138920 2023-11-01T03:18:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.535+0000 7fc5997fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940145e0 con 0x7fc59c138920 2023-11-01T03:18:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: dump: 2023-11-01T03:18:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:12.578 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: _finish_auth 0 2023-11-01T03:18:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: _check_auth_tickets 2023-11-01T03:18:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400d070 con 0x7fc59c138920 2023-11-01T03:18:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594014980 con 0x7fc59c138920 2023-11-01T03:18:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 5 monclient: authenticate success, global_id 4100 2023-11-01T03:18:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 10 monclient: _renew_subs 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c144e90 con 0x7fc59c138920 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc59affd640 4 set_mon_vals no callback set 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5997fa640 10 monclient: dump: 2023-11-01T03:18:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:12.582 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 10 client.4100.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 10 monclient: _renew_subs 2023-11-01T03:18:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c1d6ca0 con 0x7fc59c138920 2023-11-01T03:18:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.574+0000 7fc5a2bd7640 1 librados: init done 2023-11-01T03:18:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.575+0000 7fc5a2bd7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.575+0000 7fc5a2bd7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.575+0000 7fc5a2bd7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.575+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c0b12c0 con 0x7fc59c138920 2023-11-01T03:18:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc594015470 con 0x7fc59c138920 2023-11-01T03:18:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc59401e6f0 con 0x7fc59c138920 2023-11-01T03:18:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 10 client.4100.objecter ms_dispatch 0x7fc59c000b90 osd_map(1..1 src has 1..1) v4 2023-11-01T03:18:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 3 client.4100.objecter handle_osd_map got epochs [1,1] > 0 2023-11-01T03:18:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 3 client.4100.objecter handle_osd_map decoding full epoch 1 2023-11-01T03:18:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 20 client.4100.objecter dump_active .. 0 homeless 2023-11-01T03:18:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.818+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc59401a070 con 0x7fc59c138920 2023-11-01T03:18:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.819+0000 7fc5997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.819+0000 7fc5997fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.888+0000 7fc5a2bd7640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-01T03:18:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.888+0000 7fc5a2bd7640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-01T03:18:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.888+0000 7fc5a2bd7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:12.888+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc59c145080 con 0x7fc59c138920 2023-11-01T03:18:13.050 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.049+0000 7fd00ee2c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-01T03:18:13.105 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.104+0000 7fd00ee2c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-01T03:18:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.174+0000 7fc5997fa640 1 -- 172.21.15.5:0/1270030354 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc59401e9c0 con 0x7fc59c138920 2023-11-01T03:18:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.174+0000 7fc5997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-01T03:18:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.174+0000 7fc5997fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2023-11-01T03:18:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-11-01T03:18:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 10 librados: watch_flush enter 2023-11-01T03:18:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 10 librados: watch_flush exit 2023-11-01T03:18:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 20 client.4100.objecter shutdown clearing up homeless session... 2023-11-01T03:18:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 10 client.4100.objecter successfully canceled tick 2023-11-01T03:18:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 10 monclient: shutdown 2023-11-01T03:18:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 msgr2=0x7fc59c1d6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0a8650 tx=0x7fc5940087c0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 shutdown_connections 2023-11-01T03:18:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc59c138920 0x7fc59c1d6580 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc59c144a30 0x7fc59c1383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 --2- 172.21.15.5:0/1270030354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc58c003fa0 0x7fc59c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 >> 172.21.15.5:0/1270030354 conn(0x7fc59c0b7230 msgr2=0x7fc59c0b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:13.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 shutdown_connections 2023-11-01T03:18:13.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 -- 172.21.15.5:0/1270030354 wait complete. 2023-11-01T03:18:13.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:13.175+0000 7fc5a2bd7640 1 librados: shutdown 2023-11-01T03:18:13.191 INFO:tasks.ceph:check_enable_crimson: False 2023-11-01T03:18:13.191 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-01T03:18:13.191 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:18:13.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-01T03:18:13.224 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:18:13.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-01T03:18:13.273 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:13.272+0000 7fe865a11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-01T03:18:13.295 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:18:13.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-01T03:18:13.326 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:13.325+0000 7fe865a11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-01T03:18:13.366 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:18:13.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-01T03:18:13.436 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:18:13.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-01T03:18:13.463 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:18:13.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-01T03:18:13.531 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:18:13.531 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-01T03:18:13.598 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-11-01T03:18:13.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-01T03:18:13.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 654b2e02-ec58-4b98-961c-a1db8e899315 0 2023-11-01T03:18:13.702 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.701+0000 7fd00ee2c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-01T03:18:13.756 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.755+0000 7fd00ee2c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-01T03:18:13.802 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.801+0000 7fd00ee2c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-01T03:18:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.804+0000 7f842b71d640 10 monclient: get_monmap_and_config 2023-11-01T03:18:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.804+0000 7f842b71d640 10 monclient: build_initial_monmap 2023-11-01T03:18:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.804+0000 7f842b71d640 10 monclient: monmap: 2023-11-01T03:18:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:13.805432+0000 2023-11-01T03:18:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:13.805432+0000 2023-11-01T03:18:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:13.807 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.804+0000 7f842b71d640 1 Processor -- start 2023-11-01T03:18:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 -- start start 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient: init 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84240b4240 0x7f84240b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-c con 0x7f84240b4240 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240b38d0 0x7f84240ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-b con 0x7f84240b38d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f84240ade00 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240b0cc0 con 0x7f84240ade00 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240b4620 con 0x7f84240b4240 2023-11-01T03:18:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240b1690 con 0x7f84240b38d0 2023-11-01T03:18:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.805+0000 7f842b71d640 10 monclient(hunting): authenticate will time out at 1365.031783s 2023-11-01T03:18:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f84294b9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84240b4240 0x7f84240b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8428cb8640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240b38d0 0x7f84240ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8429cba640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84240ade00 0x7f842413b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.153:58834/0 (socket says 172.21.15.153:58834) 2023-11-01T03:18:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8429cba640 1 -- 172.21.15.153:0/314929147 learned_addr learned my addr 172.21.15.153:0/314929147 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f84294b9640 10 monclient(hunting): get_auth_request con 0x7f84240b4240 auth_method 0 2023-11-01T03:18:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f84294b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f84294b9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f84294b9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8428cb8640 10 monclient(hunting): get_auth_request con 0x7f84240b38d0 auth_method 0 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8428cb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8428cb8640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.806+0000 7f8428cb8640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.807+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2023-11-01T03:18:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 1 -- 172.21.15.153:0/314929147 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240b38d0 msgr2=0x7f84240ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 1 --2- 172.21.15.153:0/314929147 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240b38d0 0x7f84240ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 1 -- 172.21.15.153:0/314929147 >> v1:172.21.15.5:6789/0 conn(0x7f84240ade00 legacy=0x7f842413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 10 monclient: _finish_hunting 0 2023-11-01T03:18:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.808+0000 7f84294b9640 1 monclient: found mon.noname-c 2023-11-01T03:18:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.809+0000 7f84294b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.809+0000 7f84294b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:18:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.809+0000 7f84294b9640 1 -- 172.21.15.153:0/314929147 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240aeb80 con 0x7f84240b4240 2023-11-01T03:18:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.811+0000 7f84294b9640 1 --2- 172.21.15.153:0/314929147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f84240b1150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84200097a0 tx=0x7f842002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d82e1956147126a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 1 -- 172.21.15.153:0/314929147 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842002e070 con 0x7f84240b4240 2023-11-01T03:18:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: dump: 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:13.824 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: _finish_auth 0 2023-11-01T03:18:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 1 -- 172.21.15.153:0/314929147 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84200315a0 con 0x7f84240b4240 2023-11-01T03:18:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f842b71d640 5 monclient: authenticate success, global_id 4114 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f842b71d640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f842b71d640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f842b71d640 4 set_mon_vals no callback set 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 1 -- 172.21.15.153:0/314929147 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420031930 con 0x7f84240b4240 2023-11-01T03:18:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.815+0000 7f841bfff640 10 monclient: dump: 2023-11-01T03:18:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 10 monclient: shutdown 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 -- 172.21.15.153:0/314929147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 msgr2=0x7f84240b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 --2- 172.21.15.153:0/314929147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f84240b1150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84200097a0 tx=0x7f842002b840 comp rx=0 tx=0).stop 2023-11-01T03:18:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 -- 172.21.15.153:0/314929147 shutdown_connections 2023-11-01T03:18:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 --2- 172.21.15.153:0/314929147 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240b38d0 0x7f84240ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 --2- 172.21.15.153:0/314929147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f84240b1150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 -- 172.21.15.153:0/314929147 >> 172.21.15.153:0/314929147 conn(0x7f8424065cd0 msgr2=0x7f84240660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 -- 172.21.15.153:0/314929147 shutdown_connections 2023-11-01T03:18:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.816+0000 7f842b71d640 1 -- 172.21.15.153:0/314929147 wait complete. 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 10 monclient: build_initial_monmap 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 10 monclient: monmap: 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:13.831 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:13.832 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:13.832 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.832 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:13.832 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:13.832 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 librados: starting msgr at 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 librados: starting objecter 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 Processor -- start 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 -- start start 2023-11-01T03:18:13.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 librados: setting wanted keys 2023-11-01T03:18:13.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 1 librados: calling monclient init 2023-11-01T03:18:13.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.817+0000 7f842b71d640 10 monclient: init 2023-11-01T03:18:13.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:13.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:18:13.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240ade00 0x7f8424141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-c con 0x7f84240ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-b con 0x7f84240b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8424137330 0x7f84241377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): picked mon.noname-a con 0x7f8424137330 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:13.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:13.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84241429e0 con 0x7f8424137330 2023-11-01T03:18:13.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:13.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842413e4d0 con 0x7f84240b4240 2023-11-01T03:18:13.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:13.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842413e780 con 0x7f84240ade00 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f842b71d640 10 monclient(hunting): authenticate will time out at 1365.044231s 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f8428cb8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f84294b9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240ade00 0x7f8424141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.818+0000 7f8429cba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8424137330 0x7f84241377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:13.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36668/0 (socket says 172.21.15.153:36668) 2023-11-01T03:18:13.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 1 -- 172.21.15.153:0/3934054025 learned_addr learned my addr 172.21.15.153:0/3934054025 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:13.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): get_auth_request con 0x7f84240b4240 auth_method 0 2023-11-01T03:18:13.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:13.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:13.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): get_auth_request con 0x7f84240ade00 auth_method 0 2023-11-01T03:18:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): get_auth_request con 0x7f8424137330 auth_method 0 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8428cb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f84294b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.819+0000 7f8429cba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2023-11-01T03:18:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 -- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240ade00 msgr2=0x7f8424141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240ade00 0x7f8424141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 -- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8424137330 msgr2=0x7f84241377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8424137330 0x7f84241377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 10 monclient: _finish_hunting 0 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 monclient: found mon.noname-b 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.822+0000 7f8428cb8640 1 -- 172.21.15.153:0/3934054025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8420009400 con 0x7f84240b4240 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.824+0000 7f8428cb8640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f841400e9b0 tx=0x7f841400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.824+0000 7f8419ffb640 10 client.?.objecter ms_handle_connect 0x7f84240b4240 2023-11-01T03:18:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.824+0000 7f8419ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414009670 con 0x7f84240b4240 2023-11-01T03:18:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: dump: 2023-11-01T03:18:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:13.848 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: _finish_auth 0 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400c9a0 con 0x7f84240b4240 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 5 monclient: authenticate success, global_id 4117 2023-11-01T03:18:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 10 monclient: _renew_subs 2023-11-01T03:18:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842413ed70 con 0x7f84240b4240 2023-11-01T03:18:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400cd50 con 0x7f84240b4240 2023-11-01T03:18:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f8419ffb640 10 monclient: dump: 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f841b7fe640 4 set_mon_vals no callback set 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 10 client.4117.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 10 monclient: _renew_subs 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8424137ee0 con 0x7f84240b4240 2023-11-01T03:18:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.828+0000 7f842b71d640 1 librados: init done 2023-11-01T03:18:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.829+0000 7f842b71d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.829+0000 7f842b71d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.829+0000 7f842b71d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:13.829+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842404e9f0 con 0x7f84240b4240 2023-11-01T03:18:13.860 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.860+0000 7fd00ee2c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-01T03:18:13.888 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:13.887+0000 7fe865a11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-01T03:18:13.904 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:13.903+0000 7fd00ee2c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-01T03:18:13.940 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:13.940+0000 7fe865a11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-01T03:18:13.985 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:13.984+0000 7fe865a11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-01T03:18:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8414005c90 con 0x7f84240b4240 2023-11-01T03:18:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84140137b0 con 0x7f84240b4240 2023-11-01T03:18:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 10 client.4117.objecter ms_dispatch 0x7f8424000b90 osd_map(2..2 src has 1..2) v4 2023-11-01T03:18:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 3 client.4117.objecter handle_osd_map got epochs [2,2] > 0 2023-11-01T03:18:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 3 client.4117.objecter handle_osd_map decoding full epoch 2 2023-11-01T03:18:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 20 client.4117.objecter dump_active .. 0 homeless 2023-11-01T03:18:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8414021060 con 0x7f84240b4240 2023-11-01T03:18:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.002+0000 7f8419ffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:14.009 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.008+0000 7fd00ee2c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-01T03:18:14.040 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.039+0000 7fe865a11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-01T03:18:14.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.073+0000 7f842b71d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "654b2e02-ec58-4b98-961c-a1db8e899315", "id": 0}] 2023-11-01T03:18:14.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.073+0000 7f842b71d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "654b2e02-ec58-4b98-961c-a1db8e899315", "id": 0}] 2023-11-01T03:18:14.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.073+0000 7f842b71d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:14.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.073+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "654b2e02-ec58-4b98-961c-a1db8e899315", "id": 0} v 0) v1 -- 0x7f84240b6df0 con 0x7f84240b4240 2023-11-01T03:18:14.081 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.081+0000 7fd00ee2c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-01T03:18:14.083 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.082+0000 7fe865a11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-01T03:18:14.129 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.128+0000 7fd00ee2c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-01T03:18:14.183 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.182+0000 7fe865a11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-01T03:18:14.185 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.184+0000 7fd00ee2c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-01T03:18:14.239 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.239+0000 7fd00ee2c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-01T03:18:14.254 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.253+0000 7fe865a11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-01T03:18:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.269+0000 7f8419ffb640 1 -- 172.21.15.153:0/3934054025 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "654b2e02-ec58-4b98-961c-a1db8e899315", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8414017070 con 0x7f84240b4240 2023-11-01T03:18:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.269+0000 7f8419ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "654b2e02-ec58-4b98-961c-a1db8e899315", "id": 0}] 2023-11-01T03:18:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.269+0000 7f8419ffb640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:14.271 INFO:teuthology.orchestra.run.smithi153.stdout:0 2023-11-01T03:18:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 10 librados: watch_flush enter 2023-11-01T03:18:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 10 librados: watch_flush exit 2023-11-01T03:18:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 20 client.4117.objecter shutdown clearing up homeless session... 2023-11-01T03:18:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 10 client.4117.objecter successfully canceled tick 2023-11-01T03:18:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 10 monclient: shutdown 2023-11-01T03:18:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 msgr2=0x7f842413df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f841400e9b0 tx=0x7f841400ee70 comp rx=0 tx=0).stop 2023-11-01T03:18:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 shutdown_connections 2023-11-01T03:18:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8424137330 0x7f84241377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84240b4240 0x7f842413df90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 --2- 172.21.15.153:0/3934054025 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f84240ade00 0x7f8424141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 >> 172.21.15.153:0/3934054025 conn(0x7f8424065cd0 msgr2=0x7f84240b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 shutdown_connections 2023-11-01T03:18:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 -- 172.21.15.153:0/3934054025 wait complete. 2023-11-01T03:18:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.270+0000 7f842b71d640 1 librados: shutdown 2023-11-01T03:18:14.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new b99afca4-f146-40af-b59e-2136537920ee 1 2023-11-01T03:18:14.304 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.303+0000 7fe865a11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-01T03:18:14.361 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.359+0000 7fe865a11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-01T03:18:14.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.384+0000 7fc48865d640 10 monclient: get_monmap_and_config 2023-11-01T03:18:14.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.384+0000 7fc48865d640 10 monclient: build_initial_monmap 2023-11-01T03:18:14.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.384+0000 7fc48865d640 10 monclient: monmap: 2023-11-01T03:18:14.386 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:14.386 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.387 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:14.385424+0000 2023-11-01T03:18:14.387 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:14.385424+0000 2023-11-01T03:18:14.387 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:14.387 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.387 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:14.388 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:14.388 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:14.388 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:14.388 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:14.388 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 Processor -- start 2023-11-01T03:18:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 -- start start 2023-11-01T03:18:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient: init 2023-11-01T03:18:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2023-11-01T03:18:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4800b4240 0x7fc4800b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-a con 0x7fc4800b4240 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4800b38d0 0x7fc4800ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-c con 0x7fc4800b38d0 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc4800ade00 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800b0cc0 con 0x7fc4800ade00 2023-11-01T03:18:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800b4620 con 0x7fc4800b4240 2023-11-01T03:18:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800b1690 con 0x7fc4800b38d0 2023-11-01T03:18:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.385+0000 7fc48865d640 10 monclient(hunting): authenticate will time out at 1365.611796s 2023-11-01T03:18:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc4863f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4800b4240 0x7fc4800b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc485bf8640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4800b38d0 0x7fc4800ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc486bfa640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc4800ade00 0x7fc48013b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43460/0 (socket says 172.21.15.153:43460) 2023-11-01T03:18:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc486bfa640 1 -- 172.21.15.153:0/1139269200 learned_addr learned my addr 172.21.15.153:0/1139269200 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc4863f9640 10 monclient(hunting): get_auth_request con 0x7fc4800b4240 auth_method 0 2023-11-01T03:18:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc4863f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc4863f9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.386+0000 7fc4863f9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc485bf8640 10 monclient(hunting): get_auth_request con 0x7fc4800b38d0 auth_method 0 2023-11-01T03:18:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc485bf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc485bf8640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc485bf8640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.387+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 10 monclient(hunting): handle_auth_done global_id 4110 payload 274 2023-11-01T03:18:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 1 -- 172.21.15.153:0/1139269200 >> v2:172.21.15.153:3300/0 conn(0x7fc4800b38d0 msgr2=0x7fc4800ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 1 --2- 172.21.15.153:0/1139269200 >> v2:172.21.15.153:3300/0 conn(0x7fc4800b38d0 0x7fc4800ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 1 -- 172.21.15.153:0/1139269200 >> v1:172.21.15.153:6789/0 conn(0x7fc4800ade00 legacy=0x7fc48013b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 10 monclient: _finish_hunting 0 2023-11-01T03:18:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 1 monclient: found mon.noname-a 2023-11-01T03:18:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.388+0000 7fc4863f9640 1 -- 172.21.15.153:0/1139269200 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800aeb80 con 0x7fc4800b4240 2023-11-01T03:18:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.390+0000 7fc4863f9640 1 --2- 172.21.15.153:0/1139269200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800b4240 0x7fc4800b1150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0097a0 tx=0x7fc47c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d01def2d7a2313e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 1 -- 172.21.15.153:0/1139269200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c02e070 con 0x7fc4800b4240 2023-11-01T03:18:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: dump: 2023-11-01T03:18:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: _finish_auth 0 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: _check_auth_tickets 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 1 -- 172.21.15.153:0/1139269200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c0315a0 con 0x7fc4800b4240 2023-11-01T03:18:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc48865d640 5 monclient: authenticate success, global_id 4110 2023-11-01T03:18:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc48865d640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc48865d640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc48865d640 4 set_mon_vals no callback set 2023-11-01T03:18:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 1 -- 172.21.15.153:0/1139269200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c031930 con 0x7fc4800b4240 2023-11-01T03:18:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.394+0000 7fc4853f7640 10 monclient: dump: 2023-11-01T03:18:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.411 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 10 monclient: shutdown 2023-11-01T03:18:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 -- 172.21.15.153:0/1139269200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800b4240 msgr2=0x7fc4800b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 --2- 172.21.15.153:0/1139269200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800b4240 0x7fc4800b1150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0097a0 tx=0x7fc47c02b840 comp rx=0 tx=0).stop 2023-11-01T03:18:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 -- 172.21.15.153:0/1139269200 shutdown_connections 2023-11-01T03:18:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 --2- 172.21.15.153:0/1139269200 >> v2:172.21.15.153:3300/0 conn(0x7fc4800b38d0 0x7fc4800ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 --2- 172.21.15.153:0/1139269200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800b4240 0x7fc4800b1150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 -- 172.21.15.153:0/1139269200 >> 172.21.15.153:0/1139269200 conn(0x7fc480065cd0 msgr2=0x7fc4800660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 -- 172.21.15.153:0/1139269200 shutdown_connections 2023-11-01T03:18:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.395+0000 7fc48865d640 1 -- 172.21.15.153:0/1139269200 wait complete. 2023-11-01T03:18:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 10 monclient: build_initial_monmap 2023-11-01T03:18:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 10 monclient: monmap: 2023-11-01T03:18:14.414 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:14.414 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:14.414 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:14.414 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:14.414 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:14.415 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.415 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:14.415 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:14.415 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:14.415 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 librados: starting msgr at 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 librados: starting objecter 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 Processor -- start 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 -- start start 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 librados: setting wanted keys 2023-11-01T03:18:14.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 1 librados: calling monclient init 2023-11-01T03:18:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.396+0000 7fc48865d640 10 monclient: init 2023-11-01T03:18:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:18:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-a con 0x7fc4800ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4800b4240 0x7fc4800a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-b con 0x7fc4800b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc480140a00 0x7fc4801da050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): picked mon.noname-c con 0x7fc480140a00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800a87c0 con 0x7fc4800ade00 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800a84b0 con 0x7fc4800b4240 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc480140e80 con 0x7fc480140a00 2023-11-01T03:18:14.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:14.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc48865d640 10 monclient(hunting): authenticate will time out at 1365.623181s 2023-11-01T03:18:14.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.397+0000 7fc4863f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc486bfa640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc480140a00 0x7fc4801da050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.153:34172/0 (socket says 172.21.15.153:34172) 2023-11-01T03:18:14.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 1 -- 172.21.15.153:0/1285908738 learned_addr learned my addr 172.21.15.153:0/1285908738 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:14.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): get_auth_request con 0x7fc4800ade00 auth_method 0 2023-11-01T03:18:14.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc485bf8640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4800b4240 0x7fc4800a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc486bfa640 10 monclient(hunting): get_auth_request con 0x7fc480140a00 auth_method 0 2023-11-01T03:18:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc486bfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc486bfa640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc486bfa640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc4863f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc485bf8640 10 monclient(hunting): get_auth_request con 0x7fc4800b4240 auth_method 0 2023-11-01T03:18:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc485bf8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc485bf8640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.398+0000 7fc485bf8640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc486bfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc486bfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc486bfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.399+0000 7fc485bf8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 10 monclient(hunting): handle_auth_done global_id 4113 payload 824 2023-11-01T03:18:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 -- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc480140a00 msgr2=0x7fc4801da050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc480140a00 0x7fc4801da050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 -- 172.21.15.153:0/1285908738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4800b4240 msgr2=0x7fc4800a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4800b4240 0x7fc4800a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 10 monclient: _finish_hunting 0 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 monclient: found mon.noname-a 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.401+0000 7fc4863f9640 1 -- 172.21.15.153:0/1285908738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009400 con 0x7fc4800ade00 2023-11-01T03:18:14.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.403+0000 7fc4863f9640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc47c034040 tx=0x7fc47c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:14.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.403+0000 7fc476ffd640 10 client.?.objecter ms_handle_connect 0x7fc4800ade00 2023-11-01T03:18:14.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.403+0000 7fc476ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c032840 con 0x7fc4800ade00 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: dump: 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.429 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.430 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.431 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: _finish_auth 0 2023-11-01T03:18:14.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:18:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c0329c0 con 0x7fc4800ade00 2023-11-01T03:18:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c032d70 con 0x7fc4800ade00 2023-11-01T03:18:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 5 monclient: authenticate success, global_id 4113 2023-11-01T03:18:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 10 monclient: _renew_subs 2023-11-01T03:18:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4801da590 con 0x7fc4800ade00 2023-11-01T03:18:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc484bf6640 4 set_mon_vals no callback set 2023-11-01T03:18:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc476ffd640 10 monclient: dump: 2023-11-01T03:18:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.435 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.436 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 10 client.4113.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 10 monclient: _renew_subs 2023-11-01T03:18:14.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc480142e50 con 0x7fc4800ade00 2023-11-01T03:18:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.407+0000 7fc48865d640 1 librados: init done 2023-11-01T03:18:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.408+0000 7fc48865d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.408+0000 7fc48865d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.408+0000 7fc48865d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.408+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4800a8900 con 0x7fc4800ade00 2023-11-01T03:18:14.438 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.415+0000 7fe865a11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-01T03:18:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.539+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc47c04e730 con 0x7fc4800ade00 2023-11-01T03:18:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc47c0459e0 con 0x7fc4800ade00 2023-11-01T03:18:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 10 client.4113.objecter ms_dispatch 0x7fc480000b90 osd_map(3..3 src has 1..3) v4 2023-11-01T03:18:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 3 client.4113.objecter handle_osd_map got epochs [3,3] > 0 2023-11-01T03:18:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 3 client.4113.objecter handle_osd_map decoding full epoch 3 2023-11-01T03:18:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 20 client.4113.objecter dump_active .. 0 homeless 2023-11-01T03:18:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc4800a8900 con 0x7fc4800ade00 2023-11-01T03:18:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.545+0000 7fc476ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:14.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.615+0000 7fc48865d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b99afca4-f146-40af-b59e-2136537920ee", "id": 1}] 2023-11-01T03:18:14.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.615+0000 7fc48865d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b99afca4-f146-40af-b59e-2136537920ee", "id": 1}] 2023-11-01T03:18:14.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.615+0000 7fc48865d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.615+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b99afca4-f146-40af-b59e-2136537920ee", "id": 1} v 0) v1 -- 0x7fc48004e9f0 con 0x7fc4800ade00 2023-11-01T03:18:14.652 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.651+0000 7fd00ee2c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-01T03:18:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.678+0000 7fc476ffd640 1 -- 172.21.15.153:0/1285908738 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b99afca4-f146-40af-b59e-2136537920ee", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc480142e50 con 0x7fc4800ade00 2023-11-01T03:18:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.678+0000 7fc476ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b99afca4-f146-40af-b59e-2136537920ee", "id": 1}] 2023-11-01T03:18:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.678+0000 7fc476ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:14.680 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-11-01T03:18:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 10 librados: watch_flush enter 2023-11-01T03:18:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 10 librados: watch_flush exit 2023-11-01T03:18:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 20 client.4113.objecter shutdown clearing up homeless session... 2023-11-01T03:18:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 10 client.4113.objecter successfully canceled tick 2023-11-01T03:18:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 10 monclient: shutdown 2023-11-01T03:18:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 msgr2=0x7fc4801d9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc47c034040 tx=0x7fc47c0046c0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 shutdown_connections 2023-11-01T03:18:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc480140a00 0x7fc4801da050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4800b4240 0x7fc4800a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 --2- 172.21.15.153:0/1285908738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4800ade00 0x7fc4801d9a60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 >> 172.21.15.153:0/1285908738 conn(0x7fc480065cd0 msgr2=0x7fc480145680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 shutdown_connections 2023-11-01T03:18:14.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 -- 172.21.15.153:0/1285908738 wait complete. 2023-11-01T03:18:14.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.679+0000 7fc48865d640 1 librados: shutdown 2023-11-01T03:18:14.690 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 265251fa-4285-433b-8d1e-b71a60bc3336 2 2023-11-01T03:18:14.794 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.793+0000 7fd00ee2c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-01T03:18:14.801 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.800+0000 7fe865a11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-01T03:18:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 10 monclient: get_monmap_and_config 2023-11-01T03:18:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 10 monclient: build_initial_monmap 2023-11-01T03:18:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 10 monclient: monmap: 2023-11-01T03:18:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:14.829107+0000 2023-11-01T03:18:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:14.829107+0000 2023-11-01T03:18:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:14.832 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 1 Processor -- start 2023-11-01T03:18:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 1 -- start start 2023-11-01T03:18:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.828+0000 7f21b21a0640 10 monclient: init 2023-11-01T03:18:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2023-11-01T03:18:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-b con 0x7f21ac0a8cf0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f21ac13e9f0 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21ac141c40 0x7f21ac142060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-c con 0x7f21ac141c40 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0b19e0 con 0x7f21ac13e9f0 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0a9610 con 0x7f21ac141c40 2023-11-01T03:18:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0a9850 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.829+0000 7f21b21a0640 10 monclient(hunting): authenticate will time out at 1366.055419s 2023-11-01T03:18:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b199f640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21ac141c40 0x7f21ac142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b119e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b099d640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f21ac13e9f0 0x7f21ac13edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43472/0 (socket says 172.21.15.153:43472) 2023-11-01T03:18:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b099d640 1 -- 172.21.15.153:0/1262002466 learned_addr learned my addr 172.21.15.153:0/1262002466 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b119e640 10 monclient(hunting): get_auth_request con 0x7f21ac0a8cf0 auth_method 0 2023-11-01T03:18:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b119e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b119e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b119e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b199f640 10 monclient(hunting): get_auth_request con 0x7f21ac141c40 auth_method 0 2023-11-01T03:18:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b199f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b199f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.830+0000 7f21b199f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.831+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 10 monclient(hunting): handle_auth_done global_id 4115 payload 274 2023-11-01T03:18:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 1 -- 172.21.15.153:0/1262002466 >> v2:172.21.15.153:3300/0 conn(0x7f21ac141c40 msgr2=0x7f21ac142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 1 --2- 172.21.15.153:0/1262002466 >> v2:172.21.15.153:3300/0 conn(0x7f21ac141c40 0x7f21ac142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 1 -- 172.21.15.153:0/1262002466 >> v1:172.21.15.153:6789/0 conn(0x7f21ac13e9f0 legacy=0x7f21ac13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 10 monclient: _finish_hunting 0 2023-11-01T03:18:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 1 monclient: found mon.noname-b 2023-11-01T03:18:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.834+0000 7f21b119e640 1 -- 172.21.15.153:0/1262002466 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac13f500 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.836+0000 7f21b119e640 1 --2- 172.21.15.153:0/1262002466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0a90d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f21a80097a0 tx=0x7f21a802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123c6da7b194bd46 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 1 -- 172.21.15.153:0/1262002466 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a802e070 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: dump: 2023-11-01T03:18:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.849 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: _finish_auth 0 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 1 -- 172.21.15.153:0/1262002466 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a80315a0 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:14.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 1 -- 172.21.15.153:0/1262002466 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8031930 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21b21a0640 5 monclient: authenticate success, global_id 4115 2023-11-01T03:18:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21b21a0640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21b21a0640 4 set_mon_vals no callback set 2023-11-01T03:18:14.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.841+0000 7f21a3fff640 10 monclient: dump: 2023-11-01T03:18:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.852 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.853 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.854 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 10 monclient: shutdown 2023-11-01T03:18:14.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:14.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 -- 172.21.15.153:0/1262002466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 msgr2=0x7f21ac0a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 --2- 172.21.15.153:0/1262002466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0a90d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f21a80097a0 tx=0x7f21a802b840 comp rx=0 tx=0).stop 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 -- 172.21.15.153:0/1262002466 shutdown_connections 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 --2- 172.21.15.153:0/1262002466 >> v2:172.21.15.153:3300/0 conn(0x7f21ac141c40 0x7f21ac142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 --2- 172.21.15.153:0/1262002466 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0a90d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 -- 172.21.15.153:0/1262002466 >> 172.21.15.153:0/1262002466 conn(0x7f21ac0b7060 msgr2=0x7f21ac0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:14.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 -- 172.21.15.153:0/1262002466 shutdown_connections 2023-11-01T03:18:14.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 1 -- 172.21.15.153:0/1262002466 wait complete. 2023-11-01T03:18:14.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 10 monclient: build_initial_monmap 2023-11-01T03:18:14.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.842+0000 7f21b21a0640 10 monclient: monmap: 2023-11-01T03:18:14.856 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:14.856 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:14.857 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:14.858 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 librados: starting msgr at 2023-11-01T03:18:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 librados: starting objecter 2023-11-01T03:18:14.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 Processor -- start 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 -- start start 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 librados: setting wanted keys 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 librados: calling monclient init 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient: init 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:14.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:18:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-c con 0x7f21ac0a8cf0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 0x7f21ac1d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-b con 0x7f21ac13e9f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 0x7f21ac137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): picked mon.noname-a con 0x7f21ac141c40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0ab7c0 con 0x7f21ac141c40 2023-11-01T03:18:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0ac780 con 0x7f21ac13e9f0 2023-11-01T03:18:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1d9a00 con 0x7f21ac0a8cf0 2023-11-01T03:18:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.843+0000 7f21b21a0640 10 monclient(hunting): authenticate will time out at 1366.069925s 2023-11-01T03:18:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 0x7f21ac1d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b119e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b199f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 0x7f21ac137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 0x7f21ac1d9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36704/0 (socket says 172.21.15.153:36704) 2023-11-01T03:18:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 1 -- 172.21.15.153:0/2623283553 learned_addr learned my addr 172.21.15.153:0/2623283553 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 10 monclient(hunting): get_auth_request con 0x7f21ac13e9f0 auth_method 0 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.844+0000 7f21b099d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): get_auth_request con 0x7f21ac141c40 auth_method 0 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): get_auth_request con 0x7f21ac0a8cf0 auth_method 0 2023-11-01T03:18:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b199f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b099d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b099d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b099d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.845+0000 7f21b119e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 10 monclient(hunting): handle_auth_done global_id 4116 payload 824 2023-11-01T03:18:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 -- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 msgr2=0x7f21ac0ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 -- 172.21.15.153:0/2623283553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 msgr2=0x7f21ac1d9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 0x7f21ac1d9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 10 monclient: _finish_hunting 0 2023-11-01T03:18:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 monclient: found mon.noname-a 2023-11-01T03:18:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.848+0000 7f21b199f640 1 -- 172.21.15.153:0/2623283553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009400 con 0x7f21ac141c40 2023-11-01T03:18:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.850+0000 7f21b199f640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 0x7f21ac137480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21a400ebd0 tx=0x7f21a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.850+0000 7f21a1ffb640 10 client.?.objecter ms_handle_connect 0x7f21ac141c40 2023-11-01T03:18:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.850+0000 7f21a1ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400cd20 con 0x7f21ac141c40 2023-11-01T03:18:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: dump: 2023-11-01T03:18:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.874 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: _finish_auth 0 2023-11-01T03:18:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:18:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400f040 con 0x7f21ac141c40 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 5 monclient: authenticate success, global_id 4116 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 10 monclient: _renew_subs 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac145c00 con 0x7f21ac141c40 2023-11-01T03:18:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40146c0 con 0x7f21ac141c40 2023-11-01T03:18:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a1ffb640 10 monclient: dump: 2023-11-01T03:18:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:14.878 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:14.878 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:14.878 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:14.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21a37fe640 4 set_mon_vals no callback set 2023-11-01T03:18:14.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 10 client.4116.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 10 monclient: _renew_subs 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac1452a0 con 0x7f21ac141c40 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.854+0000 7f21b21a0640 1 librados: init done 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.855+0000 7f21b21a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.855+0000 7f21b21a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.855+0000 7f21b21a0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.855+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac1d9c20 con 0x7f21ac141c40 2023-11-01T03:18:14.914 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.913+0000 7fd00ee2c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-01T03:18:14.942 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:14.941+0000 7fe865a11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-01T03:18:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.958+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21a4014b20 con 0x7f21ac141c40 2023-11-01T03:18:14.961 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:14.960+0000 7fd00ee2c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-01T03:18:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f21a40133e0 con 0x7f21ac141c40 2023-11-01T03:18:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 10 client.4116.objecter ms_dispatch 0x7f21ac000b90 osd_map(4..4 src has 1..4) v4 2023-11-01T03:18:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 3 client.4116.objecter handle_osd_map got epochs [4,4] > 0 2023-11-01T03:18:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 3 client.4116.objecter handle_osd_map decoding full epoch 4 2023-11-01T03:18:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 20 client.4116.objecter dump_active .. 0 homeless 2023-11-01T03:18:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f21a403bb40 con 0x7f21ac141c40 2023-11-01T03:18:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:14.963+0000 7f21a1ffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:15.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.033+0000 7f21b21a0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "265251fa-4285-433b-8d1e-b71a60bc3336", "id": 2}] 2023-11-01T03:18:15.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.033+0000 7f21b21a0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "265251fa-4285-433b-8d1e-b71a60bc3336", "id": 2}] 2023-11-01T03:18:15.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.033+0000 7f21b21a0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.033+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "265251fa-4285-433b-8d1e-b71a60bc3336", "id": 2} v 0) v1 -- 0x7f21ac04e9f0 con 0x7f21ac141c40 2023-11-01T03:18:15.055 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.054+0000 7fe865a11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-01T03:18:15.062 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:15.062+0000 7fd00ee2c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-01T03:18:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.067+0000 7f21a1ffb640 1 -- 172.21.15.153:0/2623283553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "265251fa-4285-433b-8d1e-b71a60bc3336", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21a402a070 con 0x7f21ac141c40 2023-11-01T03:18:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.067+0000 7f21a1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "265251fa-4285-433b-8d1e-b71a60bc3336", "id": 2}] 2023-11-01T03:18:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.067+0000 7f21a1ffb640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:15.069 INFO:teuthology.orchestra.run.smithi153.stdout:2 2023-11-01T03:18:15.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 10 librados: watch_flush enter 2023-11-01T03:18:15.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 10 librados: watch_flush exit 2023-11-01T03:18:15.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 20 client.4116.objecter shutdown clearing up homeless session... 2023-11-01T03:18:15.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 10 client.4116.objecter successfully canceled tick 2023-11-01T03:18:15.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 10 monclient: shutdown 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 msgr2=0x7f21ac137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 0x7f21ac137480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21a400ebd0 tx=0x7f21a400c490 comp rx=0 tx=0).stop 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 shutdown_connections 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ac141c40 0x7f21ac137480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac13e9f0 0x7f21ac1d9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 --2- 172.21.15.153:0/2623283553 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21ac0a8cf0 0x7f21ac0ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 >> 172.21.15.153:0/2623283553 conn(0x7f21ac0b7060 msgr2=0x7f21ac0b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 shutdown_connections 2023-11-01T03:18:15.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 -- 172.21.15.153:0/2623283553 wait complete. 2023-11-01T03:18:15.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.068+0000 7f21b21a0640 1 librados: shutdown 2023-11-01T03:18:15.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 96181d44-1a99-414d-baf7-738c2b83680f 3 2023-11-01T03:18:15.105 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.104+0000 7fe865a11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-01T03:18:15.163 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:15.162+0000 7fd00ee2c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-01T03:18:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.177+0000 7f472b773640 10 monclient: get_monmap_and_config 2023-11-01T03:18:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.177+0000 7f472b773640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.177+0000 7f472b773640 10 monclient: monmap: 2023-11-01T03:18:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:15.178246+0000 2023-11-01T03:18:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:15.178246+0000 2023-11-01T03:18:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:15.181 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.177+0000 7f472b773640 1 Processor -- start 2023-11-01T03:18:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 -- start start 2023-11-01T03:18:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient: init 2023-11-01T03:18:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2023-11-01T03:18:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47240b4240 0x7f47240b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): picked mon.noname-a con 0x7f47240b4240 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:15.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f47240b38d0 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:15.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47240ade00 0x7f472413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): picked mon.noname-c con 0x7f47240ade00 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:15.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240b0cc0 con 0x7f47240b38d0 2023-11-01T03:18:15.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b4620 con 0x7f47240b4240 2023-11-01T03:18:15.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b1690 con 0x7f47240ade00 2023-11-01T03:18:15.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.178+0000 7f472b773640 10 monclient(hunting): authenticate will time out at 1366.404663s 2023-11-01T03:18:15.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f4729d10640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47240ade00 0x7f472413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47240b4240 0x7f47240b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47240b4240 0x7f47240b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.153:34182/0 (socket says 172.21.15.153:34182) 2023-11-01T03:18:15.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 1 -- 172.21.15.153:0/935088422 learned_addr learned my addr 172.21.15.153:0/935088422 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:15.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 10 monclient(hunting): get_auth_request con 0x7f47240b4240 auth_method 0 2023-11-01T03:18:15.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.179+0000 7f472950f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): get_auth_request con 0x7f47240ade00 auth_method 0 2023-11-01T03:18:15.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.180+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 10 monclient(hunting): handle_auth_done global_id 4119 payload 274 2023-11-01T03:18:15.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 1 -- 172.21.15.153:0/935088422 >> v2:172.21.15.153:3300/0 conn(0x7f47240ade00 msgr2=0x7f472413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:15.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 1 --2- 172.21.15.153:0/935088422 >> v2:172.21.15.153:3300/0 conn(0x7f47240ade00 0x7f472413b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 1 -- 172.21.15.153:0/935088422 >> v1:172.21.15.153:6789/0 conn(0x7f47240b38d0 legacy=0x7f47240ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 1 monclient: found mon.noname-a 2023-11-01T03:18:15.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.181+0000 7f472950f640 1 -- 172.21.15.153:0/935088422 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472413f5f0 con 0x7f47240b4240 2023-11-01T03:18:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.183+0000 7f472950f640 1 --2- 172.21.15.153:0/935088422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b4240 0x7f47240b1150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4714009870 tx=0x7f471402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c794db22dd4e716 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 1 -- 172.21.15.153:0/935088422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714031870 con 0x7f47240b4240 2023-11-01T03:18:15.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:15.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: dump: 2023-11-01T03:18:15.199 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.200 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.200 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.200 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.200 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.200 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.201 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.201 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.201 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.201 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 1 -- 172.21.15.153:0/935088422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140319d0 con 0x7f47240b4240 2023-11-01T03:18:15.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f472b773640 5 monclient: authenticate success, global_id 4119 2023-11-01T03:18:15.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f472b773640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:15.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f472b773640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:15.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f472b773640 4 set_mon_vals no callback set 2023-11-01T03:18:15.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 1 -- 172.21.15.153:0/935088422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714031d60 con 0x7f47240b4240 2023-11-01T03:18:15.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:15.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.187+0000 7f471bfff640 10 monclient: dump: 2023-11-01T03:18:15.205 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.205 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.205 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.205 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.205 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.206 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.206 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.206 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.206 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.206 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 10 monclient: shutdown 2023-11-01T03:18:15.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 -- 172.21.15.153:0/935088422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b4240 msgr2=0x7f47240b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 --2- 172.21.15.153:0/935088422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b4240 0x7f47240b1150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4714009870 tx=0x7f471402b910 comp rx=0 tx=0).stop 2023-11-01T03:18:15.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 -- 172.21.15.153:0/935088422 shutdown_connections 2023-11-01T03:18:15.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 --2- 172.21.15.153:0/935088422 >> v2:172.21.15.153:3300/0 conn(0x7f47240ade00 0x7f472413b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 --2- 172.21.15.153:0/935088422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b4240 0x7f47240b1150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 -- 172.21.15.153:0/935088422 >> 172.21.15.153:0/935088422 conn(0x7f4724065cd0 msgr2=0x7f47240660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 -- 172.21.15.153:0/935088422 shutdown_connections 2023-11-01T03:18:15.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 1 -- 172.21.15.153:0/935088422 wait complete. 2023-11-01T03:18:15.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.188+0000 7f472b773640 10 monclient: monmap: 2023-11-01T03:18:15.209 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.209 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.210 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:15.211 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:15.211 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:15.211 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 librados: starting msgr at 2023-11-01T03:18:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 librados: starting objecter 2023-11-01T03:18:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 Processor -- start 2023-11-01T03:18:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 -- start start 2023-11-01T03:18:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 librados: setting wanted keys 2023-11-01T03:18:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 librados: calling monclient init 2023-11-01T03:18:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient: init 2023-11-01T03:18:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:18:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240ade00 0x7f4724144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): picked mon.noname-b con 0x7f47240ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): picked mon.noname-c con 0x7f47240b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): picked mon.noname-a con 0x7f472413d470 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472413d9e0 con 0x7f472413d470 2023-11-01T03:18:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724137870 con 0x7f47240ade00 2023-11-01T03:18:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4724137a30 con 0x7f47240b4240 2023-11-01T03:18:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.189+0000 7f472b773640 10 monclient(hunting): authenticate will time out at 1366.415848s 2023-11-01T03:18:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f472950f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240ade00 0x7f4724144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4728d0e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.153:34198/0 (socket says 172.21.15.153:34198) 2023-11-01T03:18:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 1 -- 172.21.15.153:0/3881964722 learned_addr learned my addr 172.21.15.153:0/3881964722 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 10 monclient(hunting): get_auth_request con 0x7f472413d470 auth_method 0 2023-11-01T03:18:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f4729d10640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f472950f640 10 monclient(hunting): get_auth_request con 0x7f47240ade00 auth_method 0 2023-11-01T03:18:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f472950f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f472950f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.190+0000 7f472950f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f4729d10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.191+0000 7f472950f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.192+0000 7f4728d0e640 1 -- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 msgr2=0x7f472413e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-01T03:18:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.192+0000 7f4728d0e640 1 -- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 msgr2=0x7f472413e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-01T03:18:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.192+0000 7f4728d0e640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:18:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.192+0000 7f4728d0e640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:18:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 10 monclient(hunting): handle_auth_done global_id 4122 payload 824 2023-11-01T03:18:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 -- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 msgr2=0x7f472413e4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-01T03:18:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 -- 172.21.15.153:0/3881964722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240ade00 msgr2=0x7f4724144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240ade00 0x7f4724144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 monclient: found mon.noname-a 2023-11-01T03:18:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.193+0000 7f4729d10640 1 -- 172.21.15.153:0/3881964722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140094d0 con 0x7f472413d470 2023-11-01T03:18:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.196+0000 7f4729d10640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f471c00efc0 tx=0x7f471c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.196+0000 7f4719ffb640 10 client.?.objecter ms_handle_connect 0x7f472413d470 2023-11-01T03:18:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.196+0000 7f4719ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c014480 con 0x7f472413d470 2023-11-01T03:18:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: dump: 2023-11-01T03:18:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.229 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00f040 con 0x7f472413d470 2023-11-01T03:18:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 5 monclient: authenticate success, global_id 4122 2023-11-01T03:18:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 10 monclient: _renew_subs 2023-11-01T03:18:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4724137c50 con 0x7f472413d470 2023-11-01T03:18:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c014820 con 0x7f472413d470 2023-11-01T03:18:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f4719ffb640 10 monclient: dump: 2023-11-01T03:18:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.234 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f471b7fe640 4 set_mon_vals no callback set 2023-11-01T03:18:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 10 client.4122.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 10 monclient: _renew_subs 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47241d9e70 con 0x7f472413d470 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.199+0000 7f472b773640 1 librados: init done 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.200+0000 7f472b773640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.200+0000 7f472b773640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.200+0000 7f472b773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.200+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47241da8b0 con 0x7f472413d470 2023-11-01T03:18:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f471c014c80 con 0x7f472413d470 2023-11-01T03:18:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f471c026d10 con 0x7f472413d470 2023-11-01T03:18:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 10 client.4122.objecter ms_dispatch 0x7f4724000b90 osd_map(5..5 src has 1..5) v4 2023-11-01T03:18:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 3 client.4122.objecter handle_osd_map got epochs [5,5] > 0 2023-11-01T03:18:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 3 client.4122.objecter handle_osd_map decoding full epoch 5 2023-11-01T03:18:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.203+0000 7f4719ffb640 20 client.4122.objecter dump_active .. 0 homeless 2023-11-01T03:18:15.237 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.212+0000 7fe865a11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-01T03:18:15.308 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.307+0000 7fe865a11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-01T03:18:15.310 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:15.310+0000 7fd00ee2c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-01T03:18:15.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.311+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f471c018020 con 0x7f472413d470 2023-11-01T03:18:15.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.311+0000 7f4719ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.311+0000 7f4719ffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:15.359 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:15.358+0000 7fd00ee2c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-01T03:18:15.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.404+0000 7f472b773640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "96181d44-1a99-414d-baf7-738c2b83680f", "id": 3}] 2023-11-01T03:18:15.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.404+0000 7f472b773640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "96181d44-1a99-414d-baf7-738c2b83680f", "id": 3}] 2023-11-01T03:18:15.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.404+0000 7f472b773640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.404+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96181d44-1a99-414d-baf7-738c2b83680f", "id": 3} v 0) v1 -- 0x7f472404e9f0 con 0x7f472413d470 2023-11-01T03:18:15.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.454+0000 7f4719ffb640 1 -- 172.21.15.153:0/3881964722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96181d44-1a99-414d-baf7-738c2b83680f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f471c026420 con 0x7f472413d470 2023-11-01T03:18:15.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.454+0000 7f4719ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "96181d44-1a99-414d-baf7-738c2b83680f", "id": 3}] 2023-11-01T03:18:15.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.454+0000 7f4719ffb640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:15.456 INFO:teuthology.orchestra.run.smithi153.stdout:3 2023-11-01T03:18:15.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 10 librados: watch_flush enter 2023-11-01T03:18:15.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 10 librados: watch_flush exit 2023-11-01T03:18:15.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 20 client.4122.objecter shutdown clearing up homeless session... 2023-11-01T03:18:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 10 client.4122.objecter successfully canceled tick 2023-11-01T03:18:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 10 monclient: shutdown 2023-11-01T03:18:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 msgr2=0x7f4724137330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f471c00efc0 tx=0x7f471c00c490 comp rx=0 tx=0).stop 2023-11-01T03:18:15.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 shutdown_connections 2023-11-01T03:18:15.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472413d470 0x7f4724137330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240b4240 0x7f472413e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 --2- 172.21.15.153:0/3881964722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240ade00 0x7f4724144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 >> 172.21.15.153:0/3881964722 conn(0x7f4724065cd0 msgr2=0x7f47240b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 shutdown_connections 2023-11-01T03:18:15.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 -- 172.21.15.153:0/3881964722 wait complete. 2023-11-01T03:18:15.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.455+0000 7f472b773640 1 librados: shutdown 2023-11-01T03:18:15.461 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.457+0000 7fe865a11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-01T03:18:15.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 82bb6fe4-19eb-44a0-bef0-b04447166dbd 4 2023-11-01T03:18:15.503 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.502+0000 7fe865a11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-01T03:18:15.512 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:15.511+0000 7fd00ee2c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-01T03:18:15.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.599+0000 7fa234264640 10 monclient: get_monmap_and_config 2023-11-01T03:18:15.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.599+0000 7fa234264640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.599+0000 7fa234264640 10 monclient: monmap: 2023-11-01T03:18:15.602 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.602 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.602 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:15.600544+0000 2023-11-01T03:18:15.603 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:15.600544+0000 2023-11-01T03:18:15.603 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.603 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.604 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:15.604 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:15.604 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:15.604 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:15.605 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:15.605 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.600+0000 7fa234264640 1 Processor -- start 2023-11-01T03:18:15.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.600+0000 7fa234264640 1 -- start start 2023-11-01T03:18:15.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.600+0000 7fa234264640 10 monclient: init 2023-11-01T03:18:15.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2023-11-01T03:18:15.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): picked mon.noname-b con 0x7fa22c0b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:15.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa22c0b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:15.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa22c0ade00 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:15.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0b0cc0 con 0x7fa22c0b38d0 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0b1690 con 0x7fa22c0ade00 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0b4620 con 0x7fa22c0b4240 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa234264640 10 monclient(hunting): authenticate will time out at 1366.827262s 2023-11-01T03:18:15.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa232801640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa22c0ade00 0x7fa22c13b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43488/0 (socket says 172.21.15.153:43488) 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.601+0000 7fa232801640 1 -- 172.21.15.153:0/2811118996 learned_addr learned my addr 172.21.15.153:0/2811118996 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.602+0000 7fa232000640 1 --2- 172.21.15.153:0/2811118996 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.602+0000 7fa232000640 10 monclient(hunting): get_auth_request con 0x7fa22c0b4240 auth_method 0 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.602+0000 7fa232000640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.602+0000 7fa232000640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.602+0000 7fa232000640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.603+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.603+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.603+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733976256 0 0) 0x7fa22c0b1690 con 0x7fa22c0ade00 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _negotiate 2023-11-01T03:18:15.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): my global_id is 4147 2023-11-01T03:18:15.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa218003520 con 0x7fa22c0ade00 2023-11-01T03:18:15.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987704384 0 0) 0x7fa22c0b0cc0 con 0x7fa22c0b38d0 2023-11-01T03:18:15.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _negotiate 2023-11-01T03:18:15.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 10 monclient(hunting): my global_id is 4125 2023-11-01T03:18:15.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.604+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c0b1690 con 0x7fa22c0b38d0 2023-11-01T03:18:15.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 10 monclient(hunting): handle_auth_done global_id 4121 payload 274 2023-11-01T03:18:15.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 1 -- 172.21.15.153:0/2811118996 >> v1:172.21.15.153:6789/0 conn(0x7fa22c0ade00 legacy=0x7fa22c13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 1 -- 172.21.15.153:0/2811118996 >> v1:172.21.15.5:6789/0 conn(0x7fa22c0b38d0 legacy=0x7fa22c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 1 monclient: found mon.noname-b 2023-11-01T03:18:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.605+0000 7fa232000640 1 -- 172.21.15.153:0/2811118996 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c13f5f0 con 0x7fa22c0b4240 2023-11-01T03:18:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.608+0000 7fa232000640 1 --2- 172.21.15.153:0/2811118996 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c0b1150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa228009dc0 tx=0x7fa22802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd631aa9154d9304 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22802cc40 con 0x7fa22c0b4240 2023-11-01T03:18:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: dump: 2023-11-01T03:18:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.623 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22802cda0 con 0x7fa22c0b4240 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 1 -- 172.21.15.153:0/2811118996 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228034660 con 0x7fa22c0b4240 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa230ffe640 10 monclient: dump: 2023-11-01T03:18:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.626 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa234264640 5 monclient: authenticate success, global_id 4121 2023-11-01T03:18:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa234264640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.612+0000 7fa234264640 4 set_mon_vals no callback set 2023-11-01T03:18:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 10 monclient: shutdown 2023-11-01T03:18:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 -- 172.21.15.153:0/2811118996 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 msgr2=0x7fa22c0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 --2- 172.21.15.153:0/2811118996 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c0b1150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa228009dc0 tx=0x7fa22802be90 comp rx=0 tx=0).stop 2023-11-01T03:18:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 -- 172.21.15.153:0/2811118996 shutdown_connections 2023-11-01T03:18:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 --2- 172.21.15.153:0/2811118996 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c0b1150 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 -- 172.21.15.153:0/2811118996 >> 172.21.15.153:0/2811118996 conn(0x7fa22c065cd0 msgr2=0x7fa22c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 -- 172.21.15.153:0/2811118996 shutdown_connections 2023-11-01T03:18:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.613+0000 7fa234264640 1 -- 172.21.15.153:0/2811118996 wait complete. 2023-11-01T03:18:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 10 monclient: monmap: 2023-11-01T03:18:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:15.630 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:15.630 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.630 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.630 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 librados: starting msgr at 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 librados: starting objecter 2023-11-01T03:18:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 Processor -- start 2023-11-01T03:18:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 -- start start 2023-11-01T03:18:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 librados: setting wanted keys 2023-11-01T03:18:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 1 librados: calling monclient init 2023-11-01T03:18:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.614+0000 7fa234264640 10 monclient: init 2023-11-01T03:18:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:18:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 0x7fa22c13d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): picked mon.noname-a con 0x7fa22c0ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c133310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): picked mon.noname-c con 0x7fa22c0b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 0x7fa22c133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): picked mon.noname-b con 0x7fa22c13dd70 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c13ede0 con 0x7fa22c0ade00 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c145e00 con 0x7fa22c13dd70 2023-11-01T03:18:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c133d90 con 0x7fa22c0b4240 2023-11-01T03:18:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa234264640 10 monclient(hunting): authenticate will time out at 1366.841178s 2023-11-01T03:18:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.615+0000 7fa232801640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 0x7fa22c133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 0x7fa22c13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa2317ff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 0x7fa22c133850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36726/0 (socket says 172.21.15.153:36726) 2023-11-01T03:18:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 1 -- 172.21.15.153:0/1457576681 learned_addr learned my addr 172.21.15.153:0/1457576681 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): get_auth_request con 0x7fa22c13dd70 auth_method 0 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): get_auth_request con 0x7fa22c0ade00 auth_method 0 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa2317ff640 10 monclient(hunting): get_auth_request con 0x7fa22c0b4240 auth_method 0 2023-11-01T03:18:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa2317ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa2317ff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa2317ff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232000640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.616+0000 7fa232801640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.617+0000 7fa232801640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.617+0000 7fa2317ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.617+0000 7fa2317ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.617+0000 7fa2317ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 10 monclient(hunting): handle_auth_done global_id 4128 payload 824 2023-11-01T03:18:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 -- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 msgr2=0x7fa22c133310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c133310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 -- 172.21.15.153:0/1457576681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 msgr2=0x7fa22c133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 0x7fa22c133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 monclient: found mon.noname-a 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.619+0000 7fa232000640 1 -- 172.21.15.153:0/1457576681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009a70 con 0x7fa22c0ade00 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.622+0000 7fa232000640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 0x7fa22c13d830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa228033000 tx=0x7fa228004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.622+0000 7fa2227fc640 10 client.?.objecter ms_handle_connect 0x7fa22c0ade00 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.622+0000 7fa2227fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228040650 con 0x7fa22c0ade00 2023-11-01T03:18:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: dump: 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.645 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.646 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280407b0 con 0x7fa22c0ade00 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 5 monclient: authenticate success, global_id 4128 2023-11-01T03:18:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228040b60 con 0x7fa22c0ade00 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 10 monclient: _renew_subs 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c13c9f0 con 0x7fa22c0ade00 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa223fff640 4 set_mon_vals no callback set 2023-11-01T03:18:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa2227fc640 10 monclient: dump: 2023-11-01T03:18:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.651 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 10 client.4128.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 10 monclient: _renew_subs 2023-11-01T03:18:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c144880 con 0x7fa22c0ade00 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.626+0000 7fa234264640 1 librados: init done 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.627+0000 7fa234264640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.627+0000 7fa234264640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.627+0000 7fa234264640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.627+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c13ef20 con 0x7fa22c0ade00 2023-11-01T03:18:15.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa228052430 con 0x7fa22c0ade00 2023-11-01T03:18:15.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa22803e910 con 0x7fa22c0ade00 2023-11-01T03:18:15.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 10 client.4128.objecter ms_dispatch 0x7fa22c000b90 osd_map(6..6 src has 1..6) v4 2023-11-01T03:18:15.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 3 client.4128.objecter handle_osd_map got epochs [6,6] > 0 2023-11-01T03:18:15.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 3 client.4128.objecter handle_osd_map decoding full epoch 6 2023-11-01T03:18:15.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.629+0000 7fa2227fc640 20 client.4128.objecter dump_active .. 0 homeless 2023-11-01T03:18:15.654 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:15.652+0000 7fe865a11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-01T03:18:15.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.731+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa22c13ef20 con 0x7fa22c0ade00 2023-11-01T03:18:15.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.731+0000 7fa2227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.731+0000 7fa2227fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:15.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.801+0000 7fa234264640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "82bb6fe4-19eb-44a0-bef0-b04447166dbd", "id": 4}] 2023-11-01T03:18:15.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.801+0000 7fa234264640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "82bb6fe4-19eb-44a0-bef0-b04447166dbd", "id": 4}] 2023-11-01T03:18:15.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.801+0000 7fa234264640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.801+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82bb6fe4-19eb-44a0-bef0-b04447166dbd", "id": 4} v 0) v1 -- 0x7fa22c13f300 con 0x7fa22c0ade00 2023-11-01T03:18:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.834+0000 7fa2227fc640 1 -- 172.21.15.153:0/1457576681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82bb6fe4-19eb-44a0-bef0-b04447166dbd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa22c13f300 con 0x7fa22c0ade00 2023-11-01T03:18:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.834+0000 7fa2227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "82bb6fe4-19eb-44a0-bef0-b04447166dbd", "id": 4}] 2023-11-01T03:18:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.834+0000 7fa2227fc640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:15.836 INFO:teuthology.orchestra.run.smithi153.stdout:4 2023-11-01T03:18:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.834+0000 7fa234264640 10 librados: watch_flush enter 2023-11-01T03:18:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 10 librados: watch_flush exit 2023-11-01T03:18:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 20 client.4128.objecter shutdown clearing up homeless session... 2023-11-01T03:18:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 10 client.4128.objecter successfully canceled tick 2023-11-01T03:18:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 10 monclient: shutdown 2023-11-01T03:18:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 msgr2=0x7fa22c13d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 0x7fa22c13d830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa228033000 tx=0x7fa228004a40 comp rx=0 tx=0).stop 2023-11-01T03:18:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 shutdown_connections 2023-11-01T03:18:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22c13dd70 0x7fa22c133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa22c0b4240 0x7fa22c133310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 --2- 172.21.15.153:0/1457576681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22c0ade00 0x7fa22c13d830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 >> 172.21.15.153:0/1457576681 conn(0x7fa22c065cd0 msgr2=0x7fa22c141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 shutdown_connections 2023-11-01T03:18:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 -- 172.21.15.153:0/1457576681 wait complete. 2023-11-01T03:18:15.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.835+0000 7fa234264640 1 librados: shutdown 2023-11-01T03:18:15.846 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36 5 2023-11-01T03:18:15.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.942+0000 7f6bf6c90640 10 monclient: get_monmap_and_config 2023-11-01T03:18:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.942+0000 7f6bf6c90640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.942+0000 7f6bf6c90640 10 monclient: monmap: 2023-11-01T03:18:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:15.943900+0000 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:15.943900+0000 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:15.946 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:15.946 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:15.946 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.943+0000 7f6bf6c90640 1 Processor -- start 2023-11-01T03:18:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.943+0000 7f6bf6c90640 1 -- start start 2023-11-01T03:18:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.943+0000 7f6bf6c90640 10 monclient: init 2023-11-01T03:18:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2023-11-01T03:18:15.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6bf00b4240 0x7f6bf00b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-c con 0x7f6bf00b4240 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6bf00b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00ade00 0x7f6bf013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-b con 0x7f6bf00ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:15.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00b0cc0 con 0x7f6bf00b38d0 2023-11-01T03:18:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00b4620 con 0x7f6bf00b4240 2023-11-01T03:18:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b1690 con 0x7f6bf00ade00 2023-11-01T03:18:15.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf6c90640 10 monclient(hunting): authenticate will time out at 1367.170214s 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6beffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6bf00b38d0 0x7f6bf00ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.153:58858/0 (socket says 172.21.15.153:58858) 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.944+0000 7f6bf4a2c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6bf00b4240 0x7f6bf00b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6beffff640 1 -- 172.21.15.153:0/2709969796 learned_addr learned my addr 172.21.15.153:0/2709969796 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf522d640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00ade00 0x7f6bf013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf4a2c640 10 monclient(hunting): get_auth_request con 0x7f6bf00b4240 auth_method 0 2023-11-01T03:18:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf4a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf4a2c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf4a2c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf522d640 10 monclient(hunting): get_auth_request con 0x7f6bf00ade00 auth_method 0 2023-11-01T03:18:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf522d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.945+0000 7f6bf522d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.946+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 1 -- 172.21.15.153:0/2709969796 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953750193 0 0) 0x7f6bf00b0cc0 con 0x7f6bf00b38d0 2023-11-01T03:18:15.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 10 monclient(hunting): _negotiate 2023-11-01T03:18:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 10 monclient(hunting): my global_id is 4131 2023-11-01T03:18:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.947+0000 7f6bef7fe640 1 -- 172.21.15.153:0/2709969796 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be0003520 con 0x7f6bf00b38d0 2023-11-01T03:18:15.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_done global_id 4153 payload 274 2023-11-01T03:18:15.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 1 -- 172.21.15.153:0/2709969796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00ade00 msgr2=0x7f6bf013b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:15.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00ade00 0x7f6bf013b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 1 -- 172.21.15.153:0/2709969796 >> v1:172.21.15.5:6789/0 conn(0x7f6bf00b38d0 legacy=0x7f6bf00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 1 monclient: found mon.noname-c 2023-11-01T03:18:15.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:18:15.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.948+0000 7f6bf4a2c640 1 -- 172.21.15.153:0/2709969796 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf013f5f0 con 0x7f6bf00b4240 2023-11-01T03:18:15.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.950+0000 7f6bf4a2c640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00b4240 0x7f6bf00b1150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6be40097d0 tx=0x7f6be402b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d6542c7d0a8632 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 1 -- 172.21.15.153:0/2709969796 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4031770 con 0x7f6bf00b4240 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: dump: 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.963 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.964 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.965 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 1 -- 172.21.15.153:0/2709969796 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40318d0 con 0x7f6bf00b4240 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bf6c90640 5 monclient: authenticate success, global_id 4153 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bf6c90640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 1 -- 172.21.15.153:0/2709969796 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4031c60 con 0x7f6bf00b4240 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bf6c90640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:15.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bf6c90640 4 set_mon_vals no callback set 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.955+0000 7f6bef7fe640 10 monclient: dump: 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.967 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.968 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.969 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 10 monclient: shutdown 2023-11-01T03:18:15.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:15.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 -- 172.21.15.153:0/2709969796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00b4240 msgr2=0x7f6bf00b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00b4240 0x7f6bf00b1150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6be40097d0 tx=0x7f6be402b810 comp rx=0 tx=0).stop 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 -- 172.21.15.153:0/2709969796 shutdown_connections 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00ade00 0x7f6bf013b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/2709969796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00b4240 0x7f6bf00b1150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 -- 172.21.15.153:0/2709969796 >> 172.21.15.153:0/2709969796 conn(0x7f6bf0065cd0 msgr2=0x7f6bf00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 -- 172.21.15.153:0/2709969796 shutdown_connections 2023-11-01T03:18:15.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 1 -- 172.21.15.153:0/2709969796 wait complete. 2023-11-01T03:18:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 10 monclient: build_initial_monmap 2023-11-01T03:18:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.956+0000 7f6bf6c90640 10 monclient: monmap: 2023-11-01T03:18:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:15.971 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:15.972 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 librados: starting msgr at 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 librados: starting objecter 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 Processor -- start 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 -- start start 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 librados: setting wanted keys 2023-11-01T03:18:15.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 1 librados: calling monclient init 2023-11-01T03:18:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.957+0000 7f6bf6c90640 10 monclient: init 2023-11-01T03:18:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:18:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 0x7f6bf013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-b con 0x7f6bf00ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00b4240 0x7f6bf0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-c con 0x7f6bf00b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 0x7f6bf01d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): picked mon.noname-a con 0x7f6bf0145110 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0145790 con 0x7f6bf0145110 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0144960 con 0x7f6bf00ade00 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf01da1a0 con 0x7f6bf00b4240 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:15.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf6c90640 10 monclient(hunting): authenticate will time out at 1367.184226s 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6beffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00b4240 0x7f6bf0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.958+0000 7f6bf4a2c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 0x7f6bf013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 0x7f6bf01d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 0x7f6bf013e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36738/0 (socket says 172.21.15.153:36738) 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 1 -- 172.21.15.153:0/1194325646 learned_addr learned my addr 172.21.15.153:0/1194325646 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:15.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): get_auth_request con 0x7f6bf00ade00 auth_method 0 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): get_auth_request con 0x7f6bf0145110 auth_method 0 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6beffff640 10 monclient(hunting): get_auth_request con 0x7f6bf00b4240 auth_method 0 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6beffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6beffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6beffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:15.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.959+0000 7f6bf4a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.960+0000 7f6beffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.960+0000 7f6beffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:15.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.960+0000 7f6beffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 10 monclient(hunting): handle_auth_done global_id 4134 payload 824 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 -- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00b4240 msgr2=0x7f6bf0144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00b4240 0x7f6bf0144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 -- 172.21.15.153:0/1194325646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 msgr2=0x7f6bf013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 0x7f6bf013e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:15.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 10 monclient: _finish_hunting 0 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 monclient: found mon.noname-a 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.962+0000 7f6bf522d640 1 -- 172.21.15.153:0/1194325646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009400 con 0x7f6bf0145110 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.965+0000 7f6bf522d640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 0x7f6bf01d9c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6be800efc0 tx=0x7f6be800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.965+0000 7f6bed7fa640 10 client.?.objecter ms_handle_connect 0x7f6bf0145110 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.965+0000 7f6bed7fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8009c00 con 0x7f6bf0145110 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: dump: 2023-11-01T03:18:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.986 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.986 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.986 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.986 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.986 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: _finish_auth 0 2023-11-01T03:18:15.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: _check_auth_tickets 2023-11-01T03:18:15.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:15.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800f040 con 0x7f6bf0145110 2023-11-01T03:18:15.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:15.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80146c0 con 0x7f6bf0145110 2023-11-01T03:18:15.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bed7fa640 10 monclient: dump: 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.989 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:15.990 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 5 monclient: authenticate success, global_id 4134 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 10 monclient: _renew_subs 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6beeffd640 4 set_mon_vals no callback set 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf01da3d0 con 0x7f6bf0145110 2023-11-01T03:18:15.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 10 client.4134.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 10 monclient: _renew_subs 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf01da890 con 0x7f6bf0145110 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.968+0000 7f6bf6c90640 1 librados: init done 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.969+0000 7f6bf6c90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.969+0000 7f6bf6c90640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:15.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.969+0000 7f6bf6c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:15.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.969+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf004e9f0 con 0x7f6bf0145110 2023-11-01T03:18:15.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:15.971+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6be8014b20 con 0x7f6bf0145110 2023-11-01T03:18:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6be8014dd0 con 0x7f6bf0145110 2023-11-01T03:18:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 10 client.4134.objecter ms_dispatch 0x7f6bf0000b90 osd_map(7..7 src has 1..7) v4 2023-11-01T03:18:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 3 client.4134.objecter handle_osd_map got epochs [7,7] > 0 2023-11-01T03:18:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 3 client.4134.objecter handle_osd_map decoding full epoch 7 2023-11-01T03:18:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 20 client.4134.objecter dump_active .. 0 homeless 2023-11-01T03:18:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.076+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6be803bb40 con 0x7f6bf0145110 2023-11-01T03:18:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.077+0000 7f6bed7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.077+0000 7f6bed7fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:16.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.148+0000 7f6bf6c90640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36", "id": 5}] 2023-11-01T03:18:16.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.148+0000 7f6bf6c90640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36", "id": 5}] 2023-11-01T03:18:16.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.148+0000 7f6bf6c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:16.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.148+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36", "id": 5} v 0) v1 -- 0x7f6bf00b6fb0 con 0x7f6bf0145110 2023-11-01T03:18:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.215+0000 7f6bed7fa640 1 -- 172.21.15.153:0/1194325646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6be802a070 con 0x7f6bf0145110 2023-11-01T03:18:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.215+0000 7f6bed7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36", "id": 5}] 2023-11-01T03:18:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.215+0000 7f6bed7fa640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:16.217 INFO:teuthology.orchestra.run.smithi153.stdout:5 2023-11-01T03:18:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 10 librados: watch_flush enter 2023-11-01T03:18:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 10 librados: watch_flush exit 2023-11-01T03:18:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 20 client.4134.objecter shutdown clearing up homeless session... 2023-11-01T03:18:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 10 client.4134.objecter successfully canceled tick 2023-11-01T03:18:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 10 monclient: shutdown 2023-11-01T03:18:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 msgr2=0x7f6bf01d9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 0x7f6bf01d9c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6be800efc0 tx=0x7f6be800c490 comp rx=0 tx=0).stop 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 shutdown_connections 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bf0145110 0x7f6bf01d9c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6bf00b4240 0x7f6bf0144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 --2- 172.21.15.153:0/1194325646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bf00ade00 0x7f6bf013e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 >> 172.21.15.153:0/1194325646 conn(0x7f6bf0065cd0 msgr2=0x7f6bf00b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 shutdown_connections 2023-11-01T03:18:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 -- 172.21.15.153:0/1194325646 wait complete. 2023-11-01T03:18:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.216+0000 7f6bf6c90640 1 librados: shutdown 2023-11-01T03:18:16.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 43431aa9-f084-472d-9ad4-93d086ec158c 6 2023-11-01T03:18:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.328+0000 7fb02f597640 10 monclient: get_monmap_and_config 2023-11-01T03:18:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.328+0000 7fb02f597640 10 monclient: build_initial_monmap 2023-11-01T03:18:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.328+0000 7fb02f597640 10 monclient: monmap: 2023-11-01T03:18:16.329 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:16.329234+0000 2023-11-01T03:18:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:16.329234+0000 2023-11-01T03:18:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:16.332 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.328+0000 7fb02f597640 1 Processor -- start 2023-11-01T03:18:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 1 -- start start 2023-11-01T03:18:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient: init 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0280b4240 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb0280b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-b con 0x7fb0280ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280b0cc0 con 0x7fb0280b38d0 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02813f5f0 con 0x7fb0280b4240 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b4620 con 0x7fb0280ade00 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.329+0000 7fb02f597640 10 monclient(hunting): authenticate will time out at 1367.555631s 2023-11-01T03:18:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02d333640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb0280b4240 0x7fb0280b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43504/0 (socket says 172.21.15.153:43504) 2023-11-01T03:18:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02d333640 1 -- 172.21.15.153:0/399510664 learned_addr learned my addr 172.21.15.153:0/399510664 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02db34640 1 --2- 172.21.15.153:0/399510664 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02db34640 10 monclient(hunting): get_auth_request con 0x7fb0280ade00 auth_method 0 2023-11-01T03:18:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02db34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02db34640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.330+0000 7fb02db34640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.331+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.331+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.331+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 1 -- 172.21.15.153:0/399510664 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999242676 0 0) 0x7fb02813f5f0 con 0x7fb0280b4240 2023-11-01T03:18:16.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 10 monclient(hunting): _negotiate 2023-11-01T03:18:16.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 10 monclient(hunting): my global_id is 4159 2023-11-01T03:18:16.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.332+0000 7fb01ffff640 1 -- 172.21.15.153:0/399510664 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003520 con 0x7fb0280b4240 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 10 monclient(hunting): handle_auth_done global_id 4133 payload 274 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 1 -- 172.21.15.153:0/399510664 >> v1:172.21.15.153:6789/0 conn(0x7fb0280b4240 legacy=0x7fb0280b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 1 -- 172.21.15.153:0/399510664 >> v1:172.21.15.5:6789/0 conn(0x7fb0280b38d0 legacy=0x7fb0280ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 10 monclient: _finish_hunting 0 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 1 monclient: found mon.noname-b 2023-11-01T03:18:16.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:16.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:16.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.333+0000 7fb02db34640 1 -- 172.21.15.153:0/399510664 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02813b960 con 0x7fb0280ade00 2023-11-01T03:18:16.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.335+0000 7fb02db34640 1 --2- 172.21.15.153:0/399510664 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813b420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb020009df0 tx=0x7fb02002be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb1af830c2dca1f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:16.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 1 -- 172.21.15.153:0/399510664 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02002cc20 con 0x7fb0280ade00 2023-11-01T03:18:16.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:16.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: dump: 2023-11-01T03:18:16.345 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.346 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.346 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.346 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.346 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.346 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: _finish_auth 0 2023-11-01T03:18:16.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:16.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:16.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 1 -- 172.21.15.153:0/399510664 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02002cd80 con 0x7fb0280ade00 2023-11-01T03:18:16.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb02f597640 5 monclient: authenticate success, global_id 4133 2023-11-01T03:18:16.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb02f597640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:16.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb02f597640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 1 -- 172.21.15.153:0/399510664 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020034660 con 0x7fb0280ade00 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb02f597640 4 set_mon_vals no callback set 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.338+0000 7fb01ffff640 10 monclient: dump: 2023-11-01T03:18:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.352 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 10 monclient: shutdown 2023-11-01T03:18:16.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:16.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 -- 172.21.15.153:0/399510664 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 msgr2=0x7fb02813b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 --2- 172.21.15.153:0/399510664 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813b420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb020009df0 tx=0x7fb02002be70 comp rx=0 tx=0).stop 2023-11-01T03:18:16.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 -- 172.21.15.153:0/399510664 shutdown_connections 2023-11-01T03:18:16.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 --2- 172.21.15.153:0/399510664 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813b420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 -- 172.21.15.153:0/399510664 >> 172.21.15.153:0/399510664 conn(0x7fb028065cd0 msgr2=0x7fb0280660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:16.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 -- 172.21.15.153:0/399510664 shutdown_connections 2023-11-01T03:18:16.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.339+0000 7fb02f597640 1 -- 172.21.15.153:0/399510664 wait complete. 2023-11-01T03:18:16.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 10 monclient: build_initial_monmap 2023-11-01T03:18:16.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 10 monclient: monmap: 2023-11-01T03:18:16.354 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:16.354 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:16.354 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:16.355 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:16.355 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:16.355 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.355 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:16.355 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:16.356 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:16.356 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 librados: starting msgr at 2023-11-01T03:18:16.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 librados: starting objecter 2023-11-01T03:18:16.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 Processor -- start 2023-11-01T03:18:16.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 -- start start 2023-11-01T03:18:16.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 librados: setting wanted keys 2023-11-01T03:18:16.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 1 librados: calling monclient init 2023-11-01T03:18:16.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.340+0000 7fb02f597640 10 monclient: init 2023-11-01T03:18:16.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:16.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:18:16.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-c con 0x7fb0280ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:16.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-b con 0x7fb0280b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:16.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0281353a0 0x7fb028135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): picked mon.noname-a con 0x7fb0281353a0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:16.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281369b0 con 0x7fb0281353a0 2023-11-01T03:18:16.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028136be0 con 0x7fb0280b4240 2023-11-01T03:18:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb028135d70 con 0x7fb0280ade00 2023-11-01T03:18:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02f597640 10 monclient(hunting): authenticate will time out at 1367.567386s 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.341+0000 7fb02cb32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0281353a0 0x7fb028135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02d333640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36740/0 (socket says 172.21.15.153:36740) 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 1 -- 172.21.15.153:0/1032641173 learned_addr learned my addr 172.21.15.153:0/1032641173 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): get_auth_request con 0x7fb0280b4240 auth_method 0 2023-11-01T03:18:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): get_auth_request con 0x7fb0281353a0 auth_method 0 2023-11-01T03:18:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02d333640 10 monclient(hunting): get_auth_request con 0x7fb0280ade00 auth_method 0 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02d333640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02d333640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02d333640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02cb32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.342+0000 7fb02db34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.343+0000 7fb02d333640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.343+0000 7fb02d333640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.343+0000 7fb02d333640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 10 monclient(hunting): handle_auth_done global_id 4162 payload 824 2023-11-01T03:18:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 -- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 msgr2=0x7fb02813ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 -- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0281353a0 msgr2=0x7fb028135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0281353a0 0x7fb028135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 10 monclient: _finish_hunting 0 2023-11-01T03:18:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 monclient: found mon.noname-b 2023-11-01T03:18:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.345+0000 7fb02cb32640 1 -- 172.21.15.153:0/1032641173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020009a70 con 0x7fb0280b4240 2023-11-01T03:18:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.347+0000 7fb02cb32640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c480 tx=0x7fb01800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.347+0000 7fb01dffb640 10 client.?.objecter ms_handle_connect 0x7fb0280b4240 2023-11-01T03:18:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.347+0000 7fb01dffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180052d0 con 0x7fb0280b4240 2023-11-01T03:18:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: dump: 2023-11-01T03:18:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: _finish_auth 0 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: _check_auth_tickets 2023-11-01T03:18:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018005430 con 0x7fb0280b4240 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018012870 con 0x7fb0280b4240 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 5 monclient: authenticate success, global_id 4162 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 10 monclient: _renew_subs 2023-11-01T03:18:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb028137240 con 0x7fb0280b4240 2023-11-01T03:18:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01f7fe640 4 set_mon_vals no callback set 2023-11-01T03:18:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb01dffb640 10 monclient: dump: 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 10 monclient: _renew_subs 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0281d6480 con 0x7fb0280b4240 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.351+0000 7fb02f597640 1 librados: init done 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.352+0000 7fb02f597640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.352+0000 7fb02f597640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.352+0000 7fb02f597640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.352+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02804e9f0 con 0x7fb0280b4240 2023-11-01T03:18:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.354+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb018012cd0 con 0x7fb0280b4240 2023-11-01T03:18:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.354+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb018025a20 con 0x7fb0280b4240 2023-11-01T03:18:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.354+0000 7fb01dffb640 10 client.4162.objecter ms_dispatch 0x7fb028000b90 osd_map(8..8 src has 1..8) v4 2023-11-01T03:18:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.354+0000 7fb01dffb640 3 client.4162.objecter handle_osd_map got epochs [8,8] > 0 2023-11-01T03:18:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.354+0000 7fb01dffb640 3 client.4162.objecter handle_osd_map decoding full epoch 8 2023-11-01T03:18:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.355+0000 7fb01dffb640 20 client.4162.objecter dump_active .. 0 homeless 2023-11-01T03:18:16.379 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:16.370+0000 7fd00ee2c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-01T03:18:16.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.462+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb018025c00 con 0x7fb0280b4240 2023-11-01T03:18:16.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.462+0000 7fb01dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.462+0000 7fb01dffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:16.499 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:16.498+0000 7fe865a11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-01T03:18:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.534+0000 7fb02f597640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "43431aa9-f084-472d-9ad4-93d086ec158c", "id": 6}] 2023-11-01T03:18:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.534+0000 7fb02f597640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "43431aa9-f084-472d-9ad4-93d086ec158c", "id": 6}] 2023-11-01T03:18:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.534+0000 7fb02f597640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.534+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43431aa9-f084-472d-9ad4-93d086ec158c", "id": 6} v 0) v1 -- 0x7fb028136d50 con 0x7fb0280b4240 2023-11-01T03:18:16.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.608+0000 7fb01dffb640 1 -- 172.21.15.153:0/1032641173 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43431aa9-f084-472d-9ad4-93d086ec158c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb018025e50 con 0x7fb0280b4240 2023-11-01T03:18:16.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.608+0000 7fb01dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "43431aa9-f084-472d-9ad4-93d086ec158c", "id": 6}] 2023-11-01T03:18:16.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.608+0000 7fb01dffb640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:16.610 INFO:teuthology.orchestra.run.smithi153.stdout:6 2023-11-01T03:18:16.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 10 librados: watch_flush enter 2023-11-01T03:18:16.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 10 librados: watch_flush exit 2023-11-01T03:18:16.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 20 client.4162.objecter shutdown clearing up homeless session... 2023-11-01T03:18:16.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 10 client.4162.objecter successfully canceled tick 2023-11-01T03:18:16.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 10 monclient: shutdown 2023-11-01T03:18:16.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:16.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 msgr2=0x7fb028136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c480 tx=0x7fb01800c940 comp rx=0 tx=0).stop 2023-11-01T03:18:16.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 shutdown_connections 2023-11-01T03:18:16.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0281353a0 0x7fb028135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0280b4240 0x7fb028136470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 --2- 172.21.15.153:0/1032641173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb0280ade00 0x7fb02813ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 >> 172.21.15.153:0/1032641173 conn(0x7fb028065cd0 msgr2=0x7fb0280660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:16.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 shutdown_connections 2023-11-01T03:18:16.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 -- 172.21.15.153:0/1032641173 wait complete. 2023-11-01T03:18:16.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.609+0000 7fb02f597640 1 librados: shutdown 2023-11-01T03:18:16.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new d6398236-8588-413d-a391-4d52a96703b2 7 2023-11-01T03:18:16.670 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:16.669+0000 7fd00ee2c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-01T03:18:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 10 monclient: get_monmap_and_config 2023-11-01T03:18:16.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 10 monclient: build_initial_monmap 2023-11-01T03:18:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 10 monclient: monmap: 2023-11-01T03:18:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:18:16.718101+0000 2023-11-01T03:18:16.719 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:18:16.718101+0000 2023-11-01T03:18:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:16.720 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:16.721 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 1 Processor -- start 2023-11-01T03:18:16.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 1 -- start start 2023-11-01T03:18:16.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.717+0000 7f9444b53640 10 monclient: init 2023-11-01T03:18:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:16.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f94400b4240 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94400b38d0 0x7f94400ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-a con 0x7f94400b38d0 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f94400ade00 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94400b0cc0 con 0x7f94400b4240 2023-11-01T03:18:16.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94400aeb80 con 0x7f94400ade00 2023-11-01T03:18:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94400b4620 con 0x7f94400b38d0 2023-11-01T03:18:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.718+0000 7f9444b53640 10 monclient(hunting): authenticate will time out at 1367.944416s 2023-11-01T03:18:16.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943ed9d640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f94400ade00 0x7f944013b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43508/0 (socket says 172.21.15.153:43508) 2023-11-01T03:18:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943ed9d640 1 -- 172.21.15.153:0/2512391024 learned_addr learned my addr 172.21.15.153:0/2512391024 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-11-01T03:18:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943dd9b640 1 --2- 172.21.15.153:0/2512391024 >> v2:172.21.15.5:3300/0 conn(0x7f94400b38d0 0x7f94400ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943dd9b640 10 monclient(hunting): get_auth_request con 0x7f94400b38d0 auth_method 0 2023-11-01T03:18:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943dd9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.719+0000 7f943dd9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.720+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.720+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.720+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 1 -- 172.21.15.153:0/2512391024 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808426925 0 0) 0x7f94400aeb80 con 0x7f94400ade00 2023-11-01T03:18:16.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 10 monclient(hunting): _negotiate 2023-11-01T03:18:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 10 monclient(hunting): my global_id is 4165 2023-11-01T03:18:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.721+0000 7f943d59a640 1 -- 172.21.15.153:0/2512391024 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9428003520 con 0x7f94400ade00 2023-11-01T03:18:16.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 10 monclient(hunting): handle_auth_done global_id 4143 payload 274 2023-11-01T03:18:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 1 -- 172.21.15.153:0/2512391024 >> v1:172.21.15.153:6789/0 conn(0x7f94400ade00 legacy=0x7f944013b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 1 -- 172.21.15.153:0/2512391024 >> v1:172.21.15.5:6789/0 conn(0x7f94400b4240 legacy=0x7f94400b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 10 monclient: _finish_hunting 0 2023-11-01T03:18:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 1 monclient: found mon.noname-a 2023-11-01T03:18:16.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:16.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.722+0000 7f943dd9b640 1 -- 172.21.15.153:0/2512391024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944013f5f0 con 0x7f94400b38d0 2023-11-01T03:18:16.730 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:16.723+0000 7fd00ee2c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-01T03:18:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.727+0000 7f943dd9b640 1 --2- 172.21.15.153:0/2512391024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b38d0 0x7f94400ae640 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f94300097d0 tx=0x7f943002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22268d0c9952d171 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 1 -- 172.21.15.153:0/2512391024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943002e070 con 0x7f94400b38d0 2023-11-01T03:18:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: dump: 2023-11-01T03:18:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.734 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: _finish_auth 0 2023-11-01T03:18:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: _check_auth_tickets 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 1 -- 172.21.15.153:0/2512391024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94300315a0 con 0x7f94400b38d0 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 1 -- 172.21.15.153:0/2512391024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430031930 con 0x7f94400b38d0 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f9444b53640 5 monclient: authenticate success, global_id 4143 2023-11-01T03:18:16.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f9444b53640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f9444b53640 4 set_mon_vals no callback set 2023-11-01T03:18:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.730+0000 7f943d59a640 10 monclient: dump: 2023-11-01T03:18:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.737 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.738 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 10 monclient: shutdown 2023-11-01T03:18:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 -- 172.21.15.153:0/2512391024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b38d0 msgr2=0x7f94400ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 --2- 172.21.15.153:0/2512391024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b38d0 0x7f94400ae640 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f94300097d0 tx=0x7f943002b840 comp rx=0 tx=0).stop 2023-11-01T03:18:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 -- 172.21.15.153:0/2512391024 shutdown_connections 2023-11-01T03:18:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 --2- 172.21.15.153:0/2512391024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b38d0 0x7f94400ae640 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 -- 172.21.15.153:0/2512391024 >> 172.21.15.153:0/2512391024 conn(0x7f9440065cd0 msgr2=0x7f94400660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 -- 172.21.15.153:0/2512391024 shutdown_connections 2023-11-01T03:18:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.731+0000 7f9444b53640 1 -- 172.21.15.153:0/2512391024 wait complete. 2023-11-01T03:18:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.732+0000 7f9444b53640 10 monclient: build_initial_monmap 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.732+0000 7f9444b53640 10 monclient: monmap: 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 0 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 0.000000 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:created 0.000000 2023-11-01T03:18:16.744 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:16.745 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.745 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:16.745 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:16.745 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:16.745 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.732+0000 7f9444b53640 1 librados: starting msgr at 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.732+0000 7f9444b53640 1 librados: starting objecter 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.732+0000 7f9444b53640 1 Processor -- start 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 -- start start 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 librados: setting wanted keys 2023-11-01T03:18:16.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 librados: calling monclient init 2023-11-01T03:18:16.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient: init 2023-11-01T03:18:16.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:16.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:16.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-b con 0x7f94400ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:16.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b4240 0x7f94400aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-a con 0x7f94400b4240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:16.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f94400a9900 0x7f944013a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:16.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): picked mon.noname-c con 0x7f94400a9900 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:16.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94400aa970 con 0x7f94400b4240 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944013a8c0 con 0x7f94400ade00 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944013aa80 con 0x7f94400a9900 2023-11-01T03:18:16.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.733+0000 7f9444b53640 10 monclient(hunting): authenticate will time out at 1367.959532s 2023-11-01T03:18:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b4240 0x7f94400aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943ed9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f94400a9900 0x7f944013a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36748/0 (socket says 172.21.15.153:36748) 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 1 -- 172.21.15.153:0/1413514143 learned_addr learned my addr 172.21.15.153:0/1413514143 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): get_auth_request con 0x7f94400ade00 auth_method 0 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943dd9b640 10 monclient(hunting): get_auth_request con 0x7f94400b4240 auth_method 0 2023-11-01T03:18:16.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943dd9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943dd9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943ed9d640 10 monclient(hunting): get_auth_request con 0x7f94400a9900 auth_method 0 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943ed9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943ed9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.734+0000 7f943e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:16.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:16.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.735+0000 7f943ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:16.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 10 monclient(hunting): handle_auth_done global_id 4168 payload 824 2023-11-01T03:18:16.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 -- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f94400a9900 msgr2=0x7f944013a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f94400a9900 0x7f944013a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 -- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b4240 msgr2=0x7f94400aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b4240 0x7f94400aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 10 monclient: _finish_hunting 0 2023-11-01T03:18:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 monclient: found mon.noname-b 2023-11-01T03:18:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:16.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.737+0000 7f943e59c640 1 -- 172.21.15.153:0/1413514143 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009400 con 0x7f94400ade00 2023-11-01T03:18:16.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.739+0000 7f943e59c640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f943400b3e0 tx=0x7f943400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:16.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.739+0000 7f942effd640 10 client.?.objecter ms_handle_connect 0x7f94400ade00 2023-11-01T03:18:16.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.739+0000 7f942effd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:16.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434011830 con 0x7f94400ade00 2023-11-01T03:18:16.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:16.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: dump: 2023-11-01T03:18:16.760 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.760 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.760 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.760 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.760 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: _finish_auth 0 2023-11-01T03:18:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: _check_auth_tickets 2023-11-01T03:18:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94340119b0 con 0x7f94400ade00 2023-11-01T03:18:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 5 monclient: authenticate success, global_id 4168 2023-11-01T03:18:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434011d60 con 0x7f94400ade00 2023-11-01T03:18:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f942effd640 10 monclient: dump: 2023-11-01T03:18:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:epoch 1 2023-11-01T03:18:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:election_strategy: 1 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:18:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 10 monclient: _renew_subs 2023-11-01T03:18:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944013ad60 con 0x7f94400ade00 2023-11-01T03:18:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f943cd99640 4 set_mon_vals no callback set 2023-11-01T03:18:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 10 client.4168.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 10 monclient: _renew_subs 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94401d9de0 con 0x7f94400ade00 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.743+0000 7f9444b53640 1 librados: init done 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.744+0000 7f9444b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.744+0000 7f9444b53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.744+0000 7f9444b53640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.744+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94400aaf70 con 0x7f94400ade00 2023-11-01T03:18:16.783 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:16.782+0000 7fe865a11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-01T03:18:16.830 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:16.829+0000 7fd00ee2c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-01T03:18:16.835 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:16.834+0000 7fe865a11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-01T03:18:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9434024740 con 0x7f94400ade00 2023-11-01T03:18:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f943401ade0 con 0x7f94400ade00 2023-11-01T03:18:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 10 client.4168.objecter ms_dispatch 0x7f9440000b90 osd_map(9..9 src has 1..9) v4 2023-11-01T03:18:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 3 client.4168.objecter handle_osd_map got epochs [9,9] > 0 2023-11-01T03:18:16.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 3 client.4168.objecter handle_osd_map decoding full epoch 9 2023-11-01T03:18:16.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 20 client.4168.objecter dump_active .. 0 homeless 2023-11-01T03:18:16.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9434039b40 con 0x7f94400ade00 2023-11-01T03:18:16.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:16.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.842+0000 7f942effd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.927+0000 7f9444b53640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d6398236-8588-413d-a391-4d52a96703b2", "id": 7}] 2023-11-01T03:18:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.927+0000 7f9444b53640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d6398236-8588-413d-a391-4d52a96703b2", "id": 7}] 2023-11-01T03:18:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.927+0000 7f9444b53640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:16.928+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6398236-8588-413d-a391-4d52a96703b2", "id": 7} v 0) v1 -- 0x7f94400aad90 con 0x7f94400ade00 2023-11-01T03:18:16.939 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-11-01T03:18:16.938+0000 7fe865a11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-01T03:18:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.154+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f943401a720 con 0x7f94400ade00 2023-11-01T03:18:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.361+0000 7f942effd640 1 -- 172.21.15.153:0/1413514143 <== mon.1 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6398236-8588-413d-a391-4d52a96703b2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f94340218f0 con 0x7f94400ade00 2023-11-01T03:18:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.361+0000 7f942effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d6398236-8588-413d-a391-4d52a96703b2", "id": 7}] 2023-11-01T03:18:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.361+0000 7f942effd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:17.363 INFO:teuthology.orchestra.run.smithi153.stdout:7 2023-11-01T03:18:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 10 librados: watch_flush enter 2023-11-01T03:18:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 10 librados: watch_flush exit 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 20 client.4168.objecter shutdown clearing up homeless session... 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 10 client.4168.objecter successfully canceled tick 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 10 monclient: shutdown 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 msgr2=0x7f944013e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f943400b3e0 tx=0x7f943400b8a0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 shutdown_connections 2023-11-01T03:18:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f94400a9900 0x7f944013a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94400b4240 0x7f94400aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 --2- 172.21.15.153:0/1413514143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94400ade00 0x7f944013e160 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 >> 172.21.15.153:0/1413514143 conn(0x7f9440065cd0 msgr2=0x7f94400b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:17.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 shutdown_connections 2023-11-01T03:18:17.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 -- 172.21.15.153:0/1413514143 wait complete. 2023-11-01T03:18:17.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-11-01T03:18:17.362+0000 7f9444b53640 1 librados: shutdown 2023-11-01T03:18:17.373 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.374 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-01T03:18:17.374 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2023-11-01T03:18:17.376 INFO:tasks.ceph.osd.0:Started 2023-11-01T03:18:17.377 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.377 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-01T03:18:17.377 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2023-11-01T03:18:17.380 INFO:tasks.ceph.osd.1:Started 2023-11-01T03:18:17.380 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.380 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-01T03:18:17.381 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2023-11-01T03:18:17.383 INFO:tasks.ceph.osd.2:Started 2023-11-01T03:18:17.383 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.384 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-01T03:18:17.384 DEBUG:teuthology.orchestra.run.smithi005:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2023-11-01T03:18:17.386 INFO:tasks.ceph.osd.3:Started 2023-11-01T03:18:17.387 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.387 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-01T03:18:17.387 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2023-11-01T03:18:17.389 INFO:tasks.ceph.osd.4:Started 2023-11-01T03:18:17.390 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.390 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-01T03:18:17.391 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2023-11-01T03:18:17.393 INFO:tasks.ceph.osd.5:Started 2023-11-01T03:18:17.393 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.394 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-01T03:18:17.394 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2023-11-01T03:18:17.396 INFO:tasks.ceph.osd.6:Started 2023-11-01T03:18:17.396 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-01T03:18:17.397 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-01T03:18:17.397 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2023-11-01T03:18:17.399 INFO:tasks.ceph.osd.7:Started 2023-11-01T03:18:17.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.557+0000 7fc1c8846640 10 monclient: get_monmap_and_config 2023-11-01T03:18:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.557+0000 7fc1c8846640 10 monclient: build_initial_monmap 2023-11-01T03:18:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.557+0000 7fc1c8846640 10 monclient: monmap: 2023-11-01T03:18:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:18:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:18:17.558866+0000 2023-11-01T03:18:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:18:17.558866+0000 2023-11-01T03:18:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:17.562 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.558+0000 7fc1c8846640 1 Processor -- start 2023-11-01T03:18:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.558+0000 7fc1c8846640 1 -- start start 2023-11-01T03:18:17.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.558+0000 7fc1c8846640 10 monclient: init 2023-11-01T03:18:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2023-11-01T03:18:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-b con 0x7fc1c40b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1c40b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ade00 0x7fc1c413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-a con 0x7fc1c40ade00 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40b0cc0 con 0x7fc1c40b38d0 2023-11-01T03:18:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40b4620 con 0x7fc1c40ade00 2023-11-01T03:18:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40b1690 con 0x7fc1c40b4240 2023-11-01T03:18:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.559+0000 7fc1c8846640 10 monclient(hunting): authenticate will time out at 1373.783812s 2023-11-01T03:18:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.560+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49568/0 (socket says 172.21.15.5:49568) 2023-11-01T03:18:17.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 1 -- 172.21.15.5:0/3291098401 learned_addr learned my addr 172.21.15.5:0/3291098401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): get_auth_request con 0x7fc1c40b4240 auth_method 0 2023-11-01T03:18:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:17.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.561+0000 7fc1c259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 10 monclient(hunting): handle_auth_done global_id 4148 payload 274 2023-11-01T03:18:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 1 -- 172.21.15.5:0/3291098401 >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ade00 msgr2=0x7fc1c413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:17.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 1 --2- 172.21.15.5:0/3291098401 >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ade00 0x7fc1c413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 1 -- 172.21.15.5:0/3291098401 >> v1:172.21.15.5:6789/0 conn(0x7fc1c40b38d0 legacy=0x7fc1c40ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 10 monclient: _finish_hunting 0 2023-11-01T03:18:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 1 monclient: found mon.noname-b 2023-11-01T03:18:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:17.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.564+0000 7fc1c259c640 1 -- 172.21.15.5:0/3291098401 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c413f5f0 con 0x7fc1c40b4240 2023-11-01T03:18:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.569+0000 7fc1c259c640 1 --2- 172.21.15.5:0/3291098401 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d2495c885447d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:17.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 1 -- 172.21.15.5:0/3291098401 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40317c0 con 0x7fc1c40b4240 2023-11-01T03:18:17.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: dump: 2023-11-01T03:18:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.584 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.584 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:17.584 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.584 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:17.584 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: _finish_auth 0 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: _check_auth_tickets 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 1 -- 172.21.15.5:0/3291098401 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4031920 con 0x7fc1c40b4240 2023-11-01T03:18:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 1 -- 172.21.15.5:0/3291098401 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4031cb0 con 0x7fc1c40b4240 2023-11-01T03:18:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c159a640 10 monclient: dump: 2023-11-01T03:18:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:17.588 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c8846640 5 monclient: authenticate success, global_id 4148 2023-11-01T03:18:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c8846640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.581+0000 7fc1c8846640 4 set_mon_vals no callback set 2023-11-01T03:18:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 10 monclient: shutdown 2023-11-01T03:18:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 -- 172.21.15.5:0/3291098401 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 msgr2=0x7fc1c40b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:17.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 --2- 172.21.15.5:0/3291098401 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009870 tx=0x7fc1b402b860 comp rx=0 tx=0).stop 2023-11-01T03:18:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 -- 172.21.15.5:0/3291098401 shutdown_connections 2023-11-01T03:18:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 --2- 172.21.15.5:0/3291098401 >> v2:172.21.15.5:3300/0 conn(0x7fc1c40ade00 0x7fc1c413b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 --2- 172.21.15.5:0/3291098401 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c40b4240 0x7fc1c40b1150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.582+0000 7fc1c8846640 1 -- 172.21.15.5:0/3291098401 >> 172.21.15.5:0/3291098401 conn(0x7fc1c4065cd0 msgr2=0x7fc1c40660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:17.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.584+0000 7fc1c8846640 1 -- 172.21.15.5:0/3291098401 shutdown_connections 2023-11-01T03:18:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.584+0000 7fc1c8846640 1 -- 172.21.15.5:0/3291098401 wait complete. 2023-11-01T03:18:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 10 monclient: build_initial_monmap 2023-11-01T03:18:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 10 monclient: monmap: 2023-11-01T03:18:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:18:17.594 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:17.595 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:17.595 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:18:17.595 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:17.595 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.595 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 librados: starting msgr at 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 librados: starting objecter 2023-11-01T03:18:17.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 Processor -- start 2023-11-01T03:18:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 -- start start 2023-11-01T03:18:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 librados: setting wanted keys 2023-11-01T03:18:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 1 librados: calling monclient init 2023-11-01T03:18:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.585+0000 7fc1c8846640 10 monclient: init 2023-11-01T03:18:17.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:18:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ade00 0x7fc1c4144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-a con 0x7fc1c40ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:17.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1c40b4240 0x7fc1c413e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-b con 0x7fc1c40b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): picked mon.noname-c con 0x7fc1c413d700 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:17.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c413e670 con 0x7fc1c40ade00 2023-11-01T03:18:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c413e8c0 con 0x7fc1c40b4240 2023-11-01T03:18:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4137ba0 con 0x7fc1c413d700 2023-11-01T03:18:17.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.586+0000 7fc1c8846640 10 monclient(hunting): authenticate will time out at 1373.810526s 2023-11-01T03:18:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c1d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1c40b4240 0x7fc1c413e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49570/0 (socket says 172.21.15.5:49570) 2023-11-01T03:18:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 1 -- 172.21.15.5:0/803000862 learned_addr learned my addr 172.21.15.5:0/803000862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 10 monclient(hunting): get_auth_request con 0x7fc1c413d700 auth_method 0 2023-11-01T03:18:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c2d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:17.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c1d9b640 10 monclient(hunting): get_auth_request con 0x7fc1c40b4240 auth_method 0 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c1d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.587+0000 7fc1c1d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:17.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:17.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:17.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.588+0000 7fc1c1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:17.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 10 monclient(hunting): handle_auth_done global_id 4151 payload 824 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 -- 172.21.15.5:0/803000862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1c40b4240 msgr2=0x7fc1c413e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1c40b4240 0x7fc1c413e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 -- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ade00 msgr2=0x7fc1c4144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ade00 0x7fc1c4144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 10 monclient: _finish_hunting 0 2023-11-01T03:18:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 monclient: found mon.noname-c 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.593+0000 7fc1c2d9d640 1 -- 172.21.15.5:0/803000862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40094d0 con 0x7fc1c413d700 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.595+0000 7fc1c2d9d640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00b9e0 tx=0x7fc1bc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.595+0000 7fc1b2ffd640 10 client.?.objecter ms_handle_connect 0x7fc1c413d700 2023-11-01T03:18:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.595+0000 7fc1b2ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.598+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00cb20 con 0x7fc1c413d700 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.598+0000 7fc1b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: dump: 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: _finish_auth 0 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:18:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00cc80 con 0x7fc1c413d700 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc014680 con 0x7fc1c413d700 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1b2ffd640 10 monclient: dump: 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:17.614 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:18:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 5 monclient: authenticate success, global_id 4151 2023-11-01T03:18:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 10 monclient: _renew_subs 2023-11-01T03:18:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c0d99640 4 set_mon_vals no callback set 2023-11-01T03:18:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 1 -- 172.21.15.5:0/803000862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c4137dc0 con 0x7fc1c413d700 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 10 client.4151.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 10 monclient: _renew_subs 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 1 -- 172.21.15.5:0/803000862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c41d6930 con 0x7fc1c413d700 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.599+0000 7fc1c8846640 1 librados: init done 2023-11-01T03:18:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.600+0000 7fc1b0ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.600+0000 7fc1b0ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.600+0000 7fc1b0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.600+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c404e9f0 con 0x7fc1c413d700 2023-11-01T03:18:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.620+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7fc1bc01d3b0 con 0x7fc1c413d700 2023-11-01T03:18:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.658+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc1bc007340 con 0x7fc1c413d700 2023-11-01T03:18:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.658+0000 7fc1b2ffd640 10 client.4151.objecter ms_dispatch 0x7fc1c4000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.658+0000 7fc1b2ffd640 3 client.4151.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.658+0000 7fc1b2ffd640 3 client.4151.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.658+0000 7fc1b2ffd640 20 client.4151.objecter dump_active .. 0 homeless 2023-11-01T03:18:17.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.762+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc1bc00ce30 con 0x7fc1c413d700 2023-11-01T03:18:17.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.762+0000 7fc1b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:17.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.762+0000 7fc1b2ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.840+0000 7fc1b0ff9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.840+0000 7fc1b0ff9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.840+0000 7fc1b0ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:17.840+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1c40adbe0 con 0x7fc1c413d700 2023-11-01T03:18:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.053+0000 7fc1b2ffd640 1 -- 172.21.15.5:0/803000862 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc1bc019020 con 0x7fc1c413d700 2023-11-01T03:18:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.053+0000 7fc1b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.053+0000 7fc1b2ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:18.055 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:18:18.056 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 10 librados: watch_flush enter 2023-11-01T03:18:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 10 librados: watch_flush exit 2023-11-01T03:18:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 20 client.4151.objecter shutdown clearing up homeless session... 2023-11-01T03:18:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 10 client.4151.objecter successfully canceled tick 2023-11-01T03:18:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 10 monclient: shutdown 2023-11-01T03:18:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 msgr2=0x7fc1c4137660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00b9e0 tx=0x7fc1bc00bea0 comp rx=0 tx=0).stop 2023-11-01T03:18:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 shutdown_connections 2023-11-01T03:18:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc1c413d700 0x7fc1c4137660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1c40b4240 0x7fc1c413e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 --2- 172.21.15.5:0/803000862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1c40ade00 0x7fc1c4144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 >> 172.21.15.5:0/803000862 conn(0x7fc1c4065cd0 msgr2=0x7fc1c40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 shutdown_connections 2023-11-01T03:18:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.055+0000 7fc1b0ff9640 1 -- 172.21.15.5:0/803000862 wait complete. 2023-11-01T03:18:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:18:18.056+0000 7fc1b0ff9640 1 librados: shutdown 2023-11-01T03:18:18.071 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-01T03:18:18.072 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-01T03:18:18.854 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:18.853+0000 7fcfaf9ab640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-01T03:18:18.877 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:18.928 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:18:18.928+0000 7fcfaf9ab640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-01T03:18:18.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.973+0000 7fc98bca9640 10 monclient: get_monmap_and_config 2023-11-01T03:18:18.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.973+0000 7fc98bca9640 10 monclient: build_initial_monmap 2023-11-01T03:18:18.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.974+0000 7fc98bca9640 10 monclient: monmap: 2023-11-01T03:18:18.975 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:18.975 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:18.975 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:18.974939+0000 2023-11-01T03:18:18.976 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:18.974939+0000 2023-11-01T03:18:18.976 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:18.976 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:18.976 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:18.976 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:18.977 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:18.977 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:18.977 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:18.977 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:18.979 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.974+0000 7fc98bca9640 1 Processor -- start 2023-11-01T03:18:18.979 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.974+0000 7fc98bca9640 1 -- start start 2023-11-01T03:18:18.979 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.974+0000 7fc98bca9640 10 monclient: init 2023-11-01T03:18:18.979 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:18.979 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc9840b4230 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-b con 0x7fc98413f160 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9840b1390 0x7fc984141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-c con 0x7fc9840b1390 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:18.980 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840a9370 con 0x7fc9840b4230 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840b4610 con 0x7fc9840b1390 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840a9010 con 0x7fc98413f160 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:18.981 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:18.975+0000 7fc98bca9640 10 monclient(hunting): authenticate will time out at 1375.199933s 2023-11-01T03:18:19.037 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.036+0000 7fc98a246640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9840b1390 0x7fc984141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:19.038 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.038+0000 7fc989244640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:19.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49584/0 (socket says 172.21.15.5:49584) 2023-11-01T03:18:19.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 1 -- 172.21.15.5:0/4163216599 learned_addr learned my addr 172.21.15.5:0/4163216599 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:19.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 10 monclient(hunting): get_auth_request con 0x7fc98413f160 auth_method 0 2023-11-01T03:18:19.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:19.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:19.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.042+0000 7fc989244640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:19.045 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.043+0000 7fc989244640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:19.045 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.043+0000 7fc989244640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:19.045 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.043+0000 7fc989244640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:19.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 10 monclient(hunting): handle_auth_done global_id 4154 payload 274 2023-11-01T03:18:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 1 -- 172.21.15.5:0/4163216599 >> v2:172.21.15.153:3300/0 conn(0x7fc9840b1390 msgr2=0x7fc984141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 1 --2- 172.21.15.5:0/4163216599 >> v2:172.21.15.153:3300/0 conn(0x7fc9840b1390 0x7fc984141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 1 -- 172.21.15.5:0/4163216599 >> v1:172.21.15.153:6789/0 conn(0x7fc9840b4230 legacy=0x7fc98413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 10 monclient: _finish_hunting 0 2023-11-01T03:18:19.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 1 monclient: found mon.noname-b 2023-11-01T03:18:19.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:19.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.046+0000 7fc989244640 1 -- 172.21.15.5:0/4163216599 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9840aa4b0 con 0x7fc98413f160 2023-11-01T03:18:19.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.048+0000 7fc989244640 1 --2- 172.21.15.5:0/4163216599 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc974009870 tx=0x7fc97402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccfbcfbe9c1beb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:19.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 1 -- 172.21.15.5:0/4163216599 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740317c0 con 0x7fc98413f160 2023-11-01T03:18:19.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: dump: 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.056 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.057 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:19.057 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:19.057 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:19.057 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:19.057 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:19.058 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:19.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: _finish_auth 0 2023-11-01T03:18:19.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: _check_auth_tickets 2023-11-01T03:18:19.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:19.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 1 -- 172.21.15.5:0/4163216599 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc974031920 con 0x7fc98413f160 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 1 -- 172.21.15.5:0/4163216599 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974031cb0 con 0x7fc98413f160 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc988a43640 10 monclient: dump: 2023-11-01T03:18:19.059 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:19.060 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:19.060 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.060 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.060 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:19.060 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:19.061 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:19.061 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:19.061 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:19.061 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:19.061 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc98bca9640 5 monclient: authenticate success, global_id 4154 2023-11-01T03:18:19.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc98bca9640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:19.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.054+0000 7fc98bca9640 4 set_mon_vals no callback set 2023-11-01T03:18:19.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 10 monclient: shutdown 2023-11-01T03:18:19.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:19.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 -- 172.21.15.5:0/4163216599 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 msgr2=0x7fc984141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:19.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 --2- 172.21.15.5:0/4163216599 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc974009870 tx=0x7fc97402b860 comp rx=0 tx=0).stop 2023-11-01T03:18:19.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 -- 172.21.15.5:0/4163216599 shutdown_connections 2023-11-01T03:18:19.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 --2- 172.21.15.5:0/4163216599 >> v2:172.21.15.153:3300/0 conn(0x7fc9840b1390 0x7fc984141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:19.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 --2- 172.21.15.5:0/4163216599 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc98413f160 0x7fc984141770 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc974009870 tx=0x7fc97402b860 comp rx=0 tx=0).stop 2023-11-01T03:18:19.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 -- 172.21.15.5:0/4163216599 >> 172.21.15.5:0/4163216599 conn(0x7fc984071920 msgr2=0x7fc984071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:19.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 -- 172.21.15.5:0/4163216599 shutdown_connections 2023-11-01T03:18:19.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.055+0000 7fc98bca9640 1 -- 172.21.15.5:0/4163216599 wait complete. 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.056+0000 7fc98bca9640 10 monclient: build_initial_monmap 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.056+0000 7fc98bca9640 10 monclient: monmap: 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:19.068 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:19.069 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:19.069 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:19.069 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:19.069 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:19.069 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:19.070 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:19.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 librados: starting msgr at 2023-11-01T03:18:19.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 librados: starting objecter 2023-11-01T03:18:19.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 Processor -- start 2023-11-01T03:18:19.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 -- start start 2023-11-01T03:18:19.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 librados: setting wanted keys 2023-11-01T03:18:19.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 1 librados: calling monclient init 2023-11-01T03:18:19.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.057+0000 7fc98bca9640 10 monclient: init 2023-11-01T03:18:19.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.058+0000 7fc98bca9640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:19.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.058+0000 7fc98bca9640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:19.072 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.058+0000 7fc98bca9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9840b1390 0x7fc984134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:19.072 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.058+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-b con 0x7fc9840b1390 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:19.072 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.058+0000 7fc98bca9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9840b4230 0x7fc984139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:19.072 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.059+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-a con 0x7fc9840b4230 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:19.072 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.059+0000 7fc98bca9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:19.073 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.059+0000 7fc98bca9640 10 monclient(hunting): picked mon.noname-c con 0x7fc984145100 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:19.073 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.059+0000 7fc98bca9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:19.073 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98413a120 con 0x7fc9840b4230 2023-11-01T03:18:19.073 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:19.073 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98413d810 con 0x7fc9840b1390 2023-11-01T03:18:19.074 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:19.074 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98413a3d0 con 0x7fc984145100 2023-11-01T03:18:19.074 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:19.074 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98bca9640 10 monclient(hunting): authenticate will time out at 1375.284111s 2023-11-01T03:18:19.074 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.060+0000 7fc98a246640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:19.075 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49596/0 (socket says 172.21.15.5:49596) 2023-11-01T03:18:19.075 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 1 -- 172.21.15.5:0/3875155411 learned_addr learned my addr 172.21.15.5:0/3875155411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:19.075 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 10 monclient(hunting): get_auth_request con 0x7fc984145100 auth_method 0 2023-11-01T03:18:19.075 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:19.075 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:19.076 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.061+0000 7fc98a246640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:19.076 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.062+0000 7fc98a246640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:19.076 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.062+0000 7fc98a246640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:19.076 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.062+0000 7fc98a246640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:19.080 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.066+0000 7fc989a45640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9840b1390 0x7fc984134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:19.080 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc989a45640 10 monclient(hunting): get_auth_request con 0x7fc9840b1390 auth_method 0 2023-11-01T03:18:19.080 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc989a45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:19.080 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc989a45640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:19.080 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc989a45640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:19.081 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 10 monclient(hunting): handle_auth_done global_id 4157 payload 824 2023-11-01T03:18:19.081 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 -- 172.21.15.5:0/3875155411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9840b1390 msgr2=0x7fc984134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:19.081 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9840b1390 0x7fc984134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:19.081 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 -- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9840b4230 msgr2=0x7fc984139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:19.081 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9840b4230 0x7fc984139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:19.082 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 10 monclient: _finish_hunting 0 2023-11-01T03:18:19.082 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 monclient: found mon.noname-c 2023-11-01T03:18:19.082 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:19.082 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.083 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.067+0000 7fc98a246640 1 -- 172.21.15.5:0/3875155411 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740094d0 con 0x7fc984145100 2023-11-01T03:18:19.083 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.071+0000 7fc98a246640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00cd70 tx=0x7fc97c00a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:19.084 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.071+0000 7fc97a7fc640 10 client.?.objecter ms_handle_connect 0x7fc984145100 2023-11-01T03:18:19.084 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.071+0000 7fc97a7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:19.084 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c003b90 con 0x7fc984145100 2023-11-01T03:18:19.085 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:19.085 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:19.085 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 10 monclient: dump: 2023-11-01T03:18:19.085 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:19.085 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:19.086 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.086 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.086 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:19.086 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:19.086 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:19.087 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:19.087 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:19.087 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:19.087 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 10 monclient: _finish_auth 0 2023-11-01T03:18:19.087 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:18:19.088 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc97a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:19.088 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 5 monclient: authenticate success, global_id 4157 2023-11-01T03:18:19.088 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 10 monclient: _renew_subs 2023-11-01T03:18:19.088 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.088 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc984145af0 con 0x7fc984145100 2023-11-01T03:18:19.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 10 client.4157.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:19.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 10 monclient: _renew_subs 2023-11-01T03:18:19.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98413c4e0 con 0x7fc984145100 2023-11-01T03:18:19.089 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.075+0000 7fc98bca9640 1 librados: init done 2023-11-01T03:18:19.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.077+0000 7fc98bca9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:19.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.077+0000 7fc98bca9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:19.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.077+0000 7fc98bca9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.090 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.077+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9840b65d0 con 0x7fc984145100 2023-11-01T03:18:19.546 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c007970 con 0x7fc984145100 2023-11-01T03:18:19.546 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:19.546 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c004020 con 0x7fc984145100 2023-11-01T03:18:19.546 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:19.547 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:19.547 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97a7fc640 10 monclient: dump: 2023-11-01T03:18:19.547 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:19.547 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:19.547 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.548 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:19.548 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:19.548 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:19.548 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:19.548 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:19.549 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:19.549 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:19.549 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.544+0000 7fc97bfff640 4 set_mon_vals no callback set 2023-11-01T03:18:19.549 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.545+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 3) v1 ==== 89067+0+0 (secure 0 0 0) 0x7fc97c004200 con 0x7fc984145100 2023-11-01T03:18:19.550 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.545+0000 7fc97a7fc640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 0x7fc96806eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:19.550 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.546+0000 7fc989a45640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 0x7fc96806eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:19.550 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.546+0000 7fc989a45640 10 monclient: get_auth_request con 0x7fc96806c650 auth_method 0 2023-11-01T03:18:19.550 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.546+0000 7fc989a45640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 0x7fc96806eb10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc980007fd0 tx=0x7fc980009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:19.551 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.546+0000 7fc97a7fc640 10 client.4157.objecter ms_handle_connect 0x7fc96806c650 2023-11-01T03:18:19.574 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc97c012070 con 0x7fc984145100 2023-11-01T03:18:19.574 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 10 client.4157.objecter ms_dispatch 0x7fc984000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:19.574 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 3 client.4157.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:19.574 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 3 client.4157.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:19.575 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 20 client.4157.objecter dump_active .. 0 homeless 2023-11-01T03:18:19.575 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc97c0554c0 con 0x7fc984145100 2023-11-01T03:18:19.575 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:19.575 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.573+0000 7fc97a7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:19.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.942+0000 7fc98bca9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:19.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.942+0000 7fc98bca9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:19.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.942+0000 7fc98bca9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:19.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:19.942+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc984075530 con 0x7fc984145100 2023-11-01T03:18:20.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.239+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc97c055890 con 0x7fc984145100 2023-11-01T03:18:20.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.244+0000 7fc97a7fc640 1 -- 172.21.15.5:0/3875155411 <== mon.2 v2:172.21.15.5:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc97c0754b0 con 0x7fc984145100 2023-11-01T03:18:20.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.244+0000 7fc97a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:20.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.244+0000 7fc97a7fc640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:20.245 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:20.246 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:20.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 10 librados: watch_flush enter 2023-11-01T03:18:20.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 10 librados: watch_flush exit 2023-11-01T03:18:20.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 20 client.4157.objecter shutdown clearing up homeless session... 2023-11-01T03:18:20.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 10 client.4157.objecter successfully canceled tick 2023-11-01T03:18:20.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 msgr2=0x7fc96806eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:20.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 0x7fc96806eb10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc980007fd0 tx=0x7fc980009040 comp rx=0 tx=0).stop 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 10 monclient: shutdown 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 msgr2=0x7fc9841455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00cd70 tx=0x7fc97c00a660 comp rx=0 tx=0).stop 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 shutdown_connections 2023-11-01T03:18:20.250 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc96806c650 0x7fc96806eb10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:20.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc984145100 0x7fc9841455b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:20.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9840b4230 0x7fc984139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:20.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 --2- 172.21.15.5:0/3875155411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9840b1390 0x7fc984134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:20.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 >> 172.21.15.5:0/3875155411 conn(0x7fc984071920 msgr2=0x7fc9840b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:20.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 shutdown_connections 2023-11-01T03:18:20.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.247+0000 7fc98bca9640 1 -- 172.21.15.5:0/3875155411 wait complete. 2023-11-01T03:18:20.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:20.248+0000 7fc98bca9640 1 librados: shutdown 2023-11-01T03:18:20.262 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-01T03:18:25.398 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:07.931 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.467 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:08.000 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.467 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:08.000 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.538 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:08.071 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.704 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:08.244 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.768 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:08.309 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.837 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:08.377 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:25.897 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:08.438 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.020 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:18:26.013+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:26.090 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:18:26.084+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:26.237 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:08.761 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.300 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:08.824 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.318 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:18:26.312+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:26.382 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:08.893 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.451 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:08.962 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.474 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:09.007 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.481 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:18:26.473+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:26.537 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:09.070 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.632 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:09.154 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.685 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:09.217 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.695 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:09.218 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.745 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:09.278 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.766 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:09.307 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.851 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:09.384 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.862 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:18:26.855+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:26.891 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:09.424 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:26.956 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:09.497 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.007 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:18:26.999+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:27.102 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:27.117 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:09.658 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.166 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:09.699 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.194 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.193+0000 7f5d9a032640 10 monclient: get_monmap_and_config 2023-11-01T03:18:27.195 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.194+0000 7f5d9a032640 10 monclient: build_initial_monmap 2023-11-01T03:18:27.195 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.194+0000 7f5d9a032640 10 monclient: monmap: 2023-11-01T03:18:27.195 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:27.195 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:27.196 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:27.194942+0000 2023-11-01T03:18:27.196 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:27.194942+0000 2023-11-01T03:18:27.196 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:27.196 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.196 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:27.197 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:27.197 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:27.197 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:27.197 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:27.197 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.199 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.194+0000 7f5d9a032640 1 Processor -- start 2023-11-01T03:18:27.200 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.194+0000 7f5d9a032640 1 -- start start 2023-11-01T03:18:27.200 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.194+0000 7f5d9a032640 10 monclient: init 2023-11-01T03:18:27.200 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:27.200 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2023-11-01T03:18:27.200 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d940b4230 0x7f5d9413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.201 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-a con 0x7f5d940b4230 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:27.201 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 0x7f5d9413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.201 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-c con 0x7f5d940b1390 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:27.201 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5d94141770 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:27.201 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940a9370 con 0x7f5d94141770 2023-11-01T03:18:27.202 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:27.202 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940b4610 con 0x7f5d940b4230 2023-11-01T03:18:27.202 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:27.202 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940a9010 con 0x7f5d940b1390 2023-11-01T03:18:27.202 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.195+0000 7f5d9a032640 10 monclient(hunting): authenticate will time out at 1383.419517s 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 0x7f5d9413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d940b4230 0x7f5d9413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 0x7f5d9413ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:54884/0 (socket says 172.21.15.5:54884) 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 1 -- 172.21.15.5:0/2236093058 learned_addr learned my addr 172.21.15.5:0/2236093058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:27.203 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 10 monclient(hunting): get_auth_request con 0x7f5d940b1390 auth_method 0 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d92ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d937fe640 10 monclient(hunting): get_auth_request con 0x7f5d940b4230 auth_method 0 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:27.204 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d937fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:27.205 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.196+0000 7f5d937fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:27.205 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:27.205 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:27.205 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:27.205 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.197+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 10 monclient(hunting): handle_auth_done global_id 4182 payload 274 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 1 -- 172.21.15.5:0/2236093058 >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 msgr2=0x7f5d9413ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 1 --2- 172.21.15.5:0/2236093058 >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 0x7f5d9413ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.206 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 1 -- 172.21.15.5:0/2236093058 >> v1:172.21.15.153:6789/0 conn(0x7f5d94141770 legacy=0x7f5d94141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.207 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 10 monclient: _finish_hunting 0 2023-11-01T03:18:27.207 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 1 monclient: found mon.noname-a 2023-11-01T03:18:27.207 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:27.207 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:27.207 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.199+0000 7f5d937fe640 1 -- 172.21.15.5:0/2236093058 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940aa4b0 con 0x7f5d940b4230 2023-11-01T03:18:27.211 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.201+0000 7f5d937fe640 1 --2- 172.21.15.5:0/2236093058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b4230 0x7f5d9413ea50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d9406d080 tx=0x7f5d8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b86adb27fd13d0b server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:27.212 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 1 -- 172.21.15.5:0/2236093058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84031830 con 0x7f5d940b4230 2023-11-01T03:18:27.212 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:27.212 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:27.212 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: dump: 2023-11-01T03:18:27.212 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:27.213 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:27.213 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.213 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.213 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:27.213 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.214 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:27.214 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:27.214 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:27.214 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.214 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: _finish_auth 0 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: _check_auth_tickets 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 1 -- 172.21.15.5:0/2236093058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84031990 con 0x7f5d940b4230 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 1 -- 172.21.15.5:0/2236093058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84031d20 con 0x7f5d940b4230 2023-11-01T03:18:27.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d927fc640 10 monclient: dump: 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.216 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:27.217 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d9a032640 5 monclient: authenticate success, global_id 4182 2023-11-01T03:18:27.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d9a032640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:27.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.205+0000 7f5d9a032640 4 set_mon_vals no callback set 2023-11-01T03:18:27.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 10 monclient: shutdown 2023-11-01T03:18:27.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:27.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 -- 172.21.15.5:0/2236093058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b4230 msgr2=0x7f5d9413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 --2- 172.21.15.5:0/2236093058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b4230 0x7f5d9413ea50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d9406d080 tx=0x7f5d8402b8d0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 -- 172.21.15.5:0/2236093058 shutdown_connections 2023-11-01T03:18:27.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 --2- 172.21.15.5:0/2236093058 >> v2:172.21.15.153:3300/0 conn(0x7f5d940b1390 0x7f5d9413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 --2- 172.21.15.5:0/2236093058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b4230 0x7f5d9413ea50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 -- 172.21.15.5:0/2236093058 >> 172.21.15.5:0/2236093058 conn(0x7f5d94071920 msgr2=0x7f5d94071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 -- 172.21.15.5:0/2236093058 shutdown_connections 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.206+0000 7f5d9a032640 1 -- 172.21.15.5:0/2236093058 wait complete. 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.207+0000 7f5d9a032640 10 monclient: build_initial_monmap 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.207+0000 7f5d9a032640 10 monclient: monmap: 2023-11-01T03:18:27.220 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.221 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:27.222 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:27.222 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:27.222 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.207+0000 7f5d9a032640 1 librados: starting msgr at 2023-11-01T03:18:27.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.207+0000 7f5d9a032640 1 librados: starting objecter 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.208+0000 7f5d9a032640 1 Processor -- start 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.208+0000 7f5d9a032640 1 -- start start 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.208+0000 7f5d9a032640 1 librados: setting wanted keys 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.208+0000 7f5d9a032640 1 librados: calling monclient init 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.208+0000 7f5d9a032640 10 monclient: init 2023-11-01T03:18:27.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 0x7f5d941d6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-a con 0x7f5d940b1390 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-b con 0x7f5d940b4230 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:27.224 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d94141770 0x7f5d9413d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.225 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): picked mon.noname-c con 0x7f5d94141770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:27.225 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:27.225 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941ca7c0 con 0x7f5d940b1390 2023-11-01T03:18:27.225 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:27.225 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941407f0 con 0x7f5d940b4230 2023-11-01T03:18:27.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:27.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d94140960 con 0x7f5d94141770 2023-11-01T03:18:27.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:27.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d9a032640 10 monclient(hunting): authenticate will time out at 1383.433358s 2023-11-01T03:18:27.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.209+0000 7f5d937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 0x7f5d941d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d93fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d94141770 0x7f5d9413d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:54886/0 (socket says 172.21.15.5:54886) 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 0x7f5d941d6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57664/0 (socket says 172.21.15.5:57664) 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 1 -- 172.21.15.5:0/811359732 learned_addr learned my addr 172.21.15.5:0/811359732 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:27.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): get_auth_request con 0x7f5d940b4230 auth_method 0 2023-11-01T03:18:27.228 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:27.228 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:27.228 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:27.228 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): get_auth_request con 0x7f5d940b1390 auth_method 0 2023-11-01T03:18:27.228 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d93fff640 10 monclient(hunting): get_auth_request con 0x7f5d94141770 auth_method 0 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d93fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:27.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d93fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:27.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:27.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:27.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:27.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:27.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:27.231 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.210+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:27.231 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.211+0000 7f5d93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:27.231 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.211+0000 7f5d93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:27.231 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.211+0000 7f5d93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:27.232 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:09.756 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 10 monclient(hunting): handle_auth_done global_id 4222 payload 824 2023-11-01T03:18:27.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 -- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d94141770 msgr2=0x7f5d9413d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d94141770 0x7f5d9413d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 -- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 msgr2=0x7f5d941d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 0x7f5d941d6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 10 monclient: _finish_hunting 0 2023-11-01T03:18:27.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 monclient: found mon.noname-b 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.213+0000 7f5d92ffd640 1 -- 172.21.15.5:0/811359732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009400 con 0x7f5d940b4230 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.215+0000 7f5d92ffd640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009fd0 tx=0x7f5d8800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.215+0000 7f5d7bfff640 10 client.?.objecter ms_handle_connect 0x7f5d940b4230 2023-11-01T03:18:27.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.215+0000 7f5d7bfff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800c8e0 con 0x7f5d940b4230 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: dump: 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:27.236 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:27.237 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.237 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.237 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:27.237 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.237 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: _finish_auth 0 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:27.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800ca40 con 0x7f5d940b4230 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800cdd0 con 0x7f5d940b4230 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:27.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d7bfff640 10 monclient: dump: 2023-11-01T03:18:27.240 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:27.240 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:27.240 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.240 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:27.240 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:27.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 5 monclient: authenticate success, global_id 4222 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 10 monclient: _renew_subs 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d94141410 con 0x7f5d940b4230 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d91ffb640 4 set_mon_vals no callback set 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 10 client.4222.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:27.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 10 monclient: _renew_subs 2023-11-01T03:18:27.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:27.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9413d7e0 con 0x7f5d940b4230 2023-11-01T03:18:27.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.220+0000 7f5d9a032640 1 librados: init done 2023-11-01T03:18:27.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.221+0000 7f5d9a032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:27.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.221+0000 7f5d9a032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:27.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.221+0000 7f5d9a032640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:27.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.221+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9413cf10 con 0x7f5d940b4230 2023-11-01T03:18:27.267 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:18:27.259+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:27.318 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:09.858 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.334 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:18:27.325+0000 5dc2340 -1 Falling back to public interface 2023-11-01T03:18:27.343 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:09.867 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.442 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:09.983 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.444 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:09.977 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.471 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.471+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5d88013470 con 0x7f5d940b4230 2023-11-01T03:18:27.472 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.471+0000 7f5d7bfff640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 0x7f5d8006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:27.472 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.471+0000 7f5d937fe640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 0x7f5d8006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:27.473 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.471+0000 7f5d937fe640 10 monclient: get_auth_request con 0x7f5d8006c7c0 auth_method 0 2023-11-01T03:18:27.473 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.472+0000 7f5d7bfff640 10 client.4222.objecter ms_handle_connect 0x7f5d8006c7c0 2023-11-01T03:18:27.473 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.472+0000 7f5d937fe640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 0x7f5d8006ec80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d84036000 tx=0x7f5d8403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:27.474 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:09.985 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.483 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5d88058b20 con 0x7f5d940b4230 2023-11-01T03:18:27.483 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 10 client.4222.objecter ms_dispatch 0x7f5d94000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:27.483 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 3 client.4222.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:27.484 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 3 client.4222.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:27.484 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 20 client.4222.objecter dump_active .. 0 homeless 2023-11-01T03:18:27.484 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d88054e60 con 0x7f5d940b4230 2023-11-01T03:18:27.484 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:27.484 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.482+0000 7f5d7bfff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:27.494 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:10.027 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.631 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:10.172 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.697+0000 7f5d9a032640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:27.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.697+0000 7f5d9a032640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:27.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.697+0000 7f5d9a032640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:27.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.697+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d9413d7e0 con 0x7f5d940b4230 2023-11-01T03:18:27.709 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:10.250 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.714 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:10.247 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.723 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:10.247 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.747 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.746+0000 7f5d7bfff640 1 -- 172.21.15.5:0/811359732 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5d9413d7e0 con 0x7f5d940b4230 2023-11-01T03:18:27.747 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.746+0000 7f5d7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:27.747 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.746+0000 7f5d7bfff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:27.748 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:27.748 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:27.749 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 10 librados: watch_flush enter 2023-11-01T03:18:27.750 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 10 librados: watch_flush exit 2023-11-01T03:18:27.750 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 20 client.4222.objecter shutdown clearing up homeless session... 2023-11-01T03:18:27.750 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 10 client.4222.objecter successfully canceled tick 2023-11-01T03:18:27.750 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 msgr2=0x7f5d8006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.750 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 0x7f5d8006ec80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d84036000 tx=0x7f5d8403c040 comp rx=0 tx=0).stop 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 10 monclient: shutdown 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 msgr2=0x7f5d9413c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009fd0 tx=0x7f5d8800ed40 comp rx=0 tx=0).stop 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 shutdown_connections 2023-11-01T03:18:27.751 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5d8006c7c0 0x7f5d8006ec80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d94141770 0x7f5d9413d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d940b4230 0x7f5d9413c750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 --2- 172.21.15.5:0/811359732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d940b1390 0x7f5d941d6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.748+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 >> 172.21.15.5:0/811359732 conn(0x7f5d94071920 msgr2=0x7f5d9413e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.749+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 shutdown_connections 2023-11-01T03:18:27.752 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.749+0000 7f5d9a032640 1 -- 172.21.15.5:0/811359732 wait complete. 2023-11-01T03:18:27.753 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:27.749+0000 7f5d9a032640 1 librados: shutdown 2023-11-01T03:18:27.759 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-01T03:18:27.764 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:10.297 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.808 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:10.340 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.812 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:10.335 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.846 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:10.356 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.900 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:10.441 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.973 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:10.514 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:27.989 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:10.522 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.033 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:10.566 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.042 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:10.566 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.165 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:10.697 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.168 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:10.708 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.178 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:10.689 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.190 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:10.713 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.237 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:10.778 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.263 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:10.796 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.298 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:10.831 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.312 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:10.836 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.432 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:10.973 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.443 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:10.954 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.492 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:11.024 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.502 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:11.042 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.521 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:11.043 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.534 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:11.067 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.565 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:11.098 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.577 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:11.101 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.700 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:11.241 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.708 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:11.219 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.756 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:11.288 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.766 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:11.307 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.785 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:11.308 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.800 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:11.333 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.834 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:11.368 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.843 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:11.367 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.964 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:11.504 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:28.973 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:11.484 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.036 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:11.568 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.048 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:11.589 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.072 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:11.595 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.130 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:11.653 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.252 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:11.793 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.256 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:11.766 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.327 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:11.859 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.332 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:11.865 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.339 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:11.872 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.364 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:11.886 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.386 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:11.919 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.393 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:11.926 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.422 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:11.945 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.552 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:12.062 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.571 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:12.111 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.620 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:12.152 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.625 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:12.166 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.657 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:12.179 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.714 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:12.237 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.798 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:12.339 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.844 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:12.354 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.853 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:12.393 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.909 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:12.441 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:29.950 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:12.472 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.203 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:12.736 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.215 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:12.738 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.242 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:12.764 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.271 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:12.794 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.347 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:12.858 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.403 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:12.914 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.688 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:13.221 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.722 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:13.244 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.745 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:13.277 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:30.778 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:13.301 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:34.566 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:34.664 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.663+0000 7f5b6d0a2640 10 monclient: get_monmap_and_config 2023-11-01T03:18:34.664 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.663+0000 7f5b6d0a2640 10 monclient: build_initial_monmap 2023-11-01T03:18:34.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.663+0000 7f5b6d0a2640 10 monclient: monmap: 2023-11-01T03:18:34.665 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:34.665 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:34.665 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:34.664431+0000 2023-11-01T03:18:34.665 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:34.664431+0000 2023-11-01T03:18:34.666 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:34.666 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.666 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:34.666 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:34.667 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:34.667 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:34.667 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:34.667 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.670 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.664+0000 7f5b6d0a2640 1 Processor -- start 2023-11-01T03:18:34.670 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.664+0000 7f5b6d0a2640 1 -- start start 2023-11-01T03:18:34.670 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.664+0000 7f5b6d0a2640 10 monclient: init 2023-11-01T03:18:34.670 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5b680b4230 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 0x7f5b68141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-c con 0x7f5b6813f160 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b680b1390 0x7f5b68141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.671 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-a con 0x7f5b680b1390 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:34.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680a9370 con 0x7f5b680b4230 2023-11-01T03:18:34.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:34.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680b4610 con 0x7f5b680b1390 2023-11-01T03:18:34.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:34.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680a9010 con 0x7f5b6813f160 2023-11-01T03:18:34.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:34.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.665+0000 7f5b6d0a2640 10 monclient(hunting): authenticate will time out at 1390.889524s 2023-11-01T03:18:34.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 0x7f5b68141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b680b1390 0x7f5b68141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 0x7f5b68141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:54896/0 (socket says 172.21.15.5:54896) 2023-11-01T03:18:34.674 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b680b1390 0x7f5b68141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57678/0 (socket says 172.21.15.5:57678) 2023-11-01T03:18:34.674 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 1 -- 172.21.15.5:0/64057395 learned_addr learned my addr 172.21.15.5:0/64057395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:34.674 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 10 monclient(hunting): get_auth_request con 0x7f5b680b1390 auth_method 0 2023-11-01T03:18:34.674 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:34.674 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6759e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 10 monclient(hunting): get_auth_request con 0x7f5b6813f160 auth_method 0 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.666+0000 7f5b6659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:34.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.667+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:34.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.667+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:34.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.667+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:34.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.668+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:34.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.668+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:34.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.668+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:34.677 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 10 monclient(hunting): handle_auth_done global_id 4188 payload 274 2023-11-01T03:18:34.677 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 1 -- 172.21.15.5:0/64057395 >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 msgr2=0x7f5b68141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:34.678 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 1 --2- 172.21.15.5:0/64057395 >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 0x7f5b68141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.678 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 1 -- 172.21.15.5:0/64057395 >> v1:172.21.15.153:6789/0 conn(0x7f5b680b4230 legacy=0x7f5b6813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:34.678 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 10 monclient: _finish_hunting 0 2023-11-01T03:18:34.678 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 1 monclient: found mon.noname-a 2023-11-01T03:18:34.678 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:34.679 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:34.679 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.669+0000 7f5b6759e640 1 -- 172.21.15.5:0/64057395 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680aa4b0 con 0x7f5b680b1390 2023-11-01T03:18:34.679 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.672+0000 7f5b6759e640 1 --2- 172.21.15.5:0/64057395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b1390 0x7f5b68141cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806d080 tx=0x7f5b6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f444948db52e2a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:34.680 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 1 -- 172.21.15.5:0/64057395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6002ca80 con 0x7f5b680b1390 2023-11-01T03:18:34.680 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: dump: 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.681 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.682 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:34.682 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.682 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:34.682 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:34.682 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:34.683 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.683 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: _finish_auth 0 2023-11-01T03:18:34.683 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: _check_auth_tickets 2023-11-01T03:18:34.683 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:34.683 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 1 -- 172.21.15.5:0/64057395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6002cbe0 con 0x7f5b680b1390 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b6d0a2640 5 monclient: authenticate success, global_id 4188 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b6d0a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 1 -- 172.21.15.5:0/64057395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600343f0 con 0x7f5b680b1390 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:34.684 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:34.685 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.677+0000 7f5b65d9b640 10 monclient: dump: 2023-11-01T03:18:34.685 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:34.685 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:34.685 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.685 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:34.686 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.687 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:34.687 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 4 set_mon_vals no callback set 2023-11-01T03:18:34.687 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 10 monclient: shutdown 2023-11-01T03:18:34.687 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:34.687 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/64057395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b1390 msgr2=0x7f5b68141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/64057395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b1390 0x7f5b68141cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806d080 tx=0x7f5b6002bee0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/64057395 shutdown_connections 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/64057395 >> v2:172.21.15.153:3300/0 conn(0x7f5b6813f160 0x7f5b68141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/64057395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b1390 0x7f5b68141cb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.678+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/64057395 >> 172.21.15.5:0/64057395 conn(0x7f5b68071920 msgr2=0x7f5b68071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:34.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.679+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/64057395 shutdown_connections 2023-11-01T03:18:34.689 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.679+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/64057395 wait complete. 2023-11-01T03:18:34.691 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.680+0000 7f5b6d0a2640 10 monclient: build_initial_monmap 2023-11-01T03:18:34.691 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.680+0000 7f5b6d0a2640 10 monclient: monmap: 2023-11-01T03:18:34.691 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:34.691 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:34.691 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:34.692 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:34.692 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:34.692 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.692 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:34.692 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.680+0000 7f5b6d0a2640 1 librados: starting msgr at 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.680+0000 7f5b6d0a2640 1 librados: starting objecter 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.680+0000 7f5b6d0a2640 1 Processor -- start 2023-11-01T03:18:34.693 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 -- start start 2023-11-01T03:18:34.694 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 librados: setting wanted keys 2023-11-01T03:18:34.694 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 librados: calling monclient init 2023-11-01T03:18:34.694 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient: init 2023-11-01T03:18:34.694 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:34.694 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-c con 0x7f5b680b1390 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b4230 0x7f5b6806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-a con 0x7f5b680b4230 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6813f160 0x7f5b6806f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.695 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient(hunting): picked mon.noname-b con 0x7f5b6813f160 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.681+0000 7f5b6d0a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68070fb0 con 0x7f5b680b4230 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6806ee20 con 0x7f5b6813f160 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:34.696 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b68145870 con 0x7f5b680b1390 2023-11-01T03:18:34.697 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:34.697 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6d0a2640 10 monclient(hunting): authenticate will time out at 1390.906359s 2023-11-01T03:18:34.697 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6759e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6813f160 0x7f5b6806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.697 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b66d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.697 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.682+0000 7f5b6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b4230 0x7f5b6806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:50534/0 (socket says 172.21.15.5:50534) 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 1 -- 172.21.15.5:0/20347421 learned_addr learned my addr 172.21.15.5:0/20347421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): get_auth_request con 0x7f5b680b1390 auth_method 0 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:34.698 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:34.699 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): get_auth_request con 0x7f5b6813f160 auth_method 0 2023-11-01T03:18:34.699 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:34.699 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:34.699 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:34.699 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): get_auth_request con 0x7f5b680b4230 auth_method 0 2023-11-01T03:18:34.700 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:34.700 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:34.700 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:34.700 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:34.700 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b66d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:34.701 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:34.702 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.683+0000 7f5b6659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:34.702 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 10 monclient(hunting): handle_auth_done global_id 4175 payload 824 2023-11-01T03:18:34.702 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 -- 172.21.15.5:0/20347421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6813f160 msgr2=0x7f5b6806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:34.702 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6813f160 0x7f5b6806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.702 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 -- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b4230 msgr2=0x7f5b6806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b4230 0x7f5b6806e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 10 monclient: _finish_hunting 0 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 monclient: found mon.noname-c 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:18:34.703 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.687+0000 7f5b66d9d640 1 -- 172.21.15.5:0/20347421 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60009b30 con 0x7f5b680b1390 2023-11-01T03:18:34.705 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.691+0000 7f5b66d9d640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c450 tx=0x7f5b5800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:34.705 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.691+0000 7f5b4f7fe640 10 client.?.objecter ms_handle_connect 0x7f5b680b1390 2023-11-01T03:18:34.705 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.691+0000 7f5b4f7fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:34.705 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b580052d0 con 0x7f5b680b1390 2023-11-01T03:18:34.706 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:34.706 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:34.706 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: dump: 2023-11-01T03:18:34.706 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:34.706 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:34.707 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:34.708 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:34.708 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.708 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: _finish_auth 0 2023-11-01T03:18:34.708 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:18:34.708 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58005430 con 0x7f5b680b1390 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b6d0a2640 5 monclient: authenticate success, global_id 4175 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58012870 con 0x7f5b680b1390 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:34.709 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:34.710 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b4f7fe640 10 monclient: dump: 2023-11-01T03:18:34.710 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:34.710 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:34.710 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.710 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:34.711 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.696+0000 7f5b6559a640 4 set_mon_vals no callback set 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 10 monclient: _renew_subs 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6806fba0 con 0x7f5b680b1390 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 10 client.4175.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:34.712 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 10 monclient: _renew_subs 2023-11-01T03:18:34.713 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:34.713 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b681de270 con 0x7f5b680b1390 2023-11-01T03:18:34.713 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.697+0000 7f5b6d0a2640 1 librados: init done 2023-11-01T03:18:34.713 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.698+0000 7f5b6d0a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:34.713 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.698+0000 7f5b6d0a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:34.714 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.698+0000 7f5b6d0a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:34.714 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.698+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b681459e0 con 0x7f5b680b1390 2023-11-01T03:18:34.732 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.731+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5b580129d0 con 0x7f5b680b1390 2023-11-01T03:18:34.732 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.732+0000 7f5b4f7fe640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 0x7f5b5406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:34.733 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.732+0000 7f5b6659c640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 0x7f5b5406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:34.733 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.732+0000 7f5b6659c640 10 monclient: get_auth_request con 0x7f5b5406c770 auth_method 0 2023-11-01T03:18:34.734 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.733+0000 7f5b4f7fe640 10 client.4175.objecter ms_handle_connect 0x7f5b5406c770 2023-11-01T03:18:34.734 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.733+0000 7f5b6659c640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 0x7f5b5406ec30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b68070b90 tx=0x7f5b5c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:34.736 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.735+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5b580588e0 con 0x7f5b680b1390 2023-11-01T03:18:34.736 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.735+0000 7f5b4f7fe640 10 client.4175.objecter ms_dispatch 0x7f5b68000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:34.736 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.735+0000 7f5b4f7fe640 3 client.4175.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:34.737 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.735+0000 7f5b4f7fe640 3 client.4175.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:34.737 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:34.735+0000 7f5b4f7fe640 20 client.4175.objecter dump_active .. 0 homeless 2023-11-01T03:18:34.840 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:17.373 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:35.022 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:17.562 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:35.057 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:17.590 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:35.065 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.065+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b58054c20 con 0x7f5b680b1390 2023-11-01T03:18:35.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.065+0000 7f5b4f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:35.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.065+0000 7f5b4f7fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:35.277 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.276+0000 7f5b6d0a2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:35.277 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.276+0000 7f5b6d0a2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:35.277 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.276+0000 7f5b6d0a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:18:35.277 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.276+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b680b60f0 con 0x7f5b680b1390 2023-11-01T03:18:35.300 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.299+0000 7f5b4f7fe640 1 -- 172.21.15.5:0/20347421 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5b58058240 con 0x7f5b680b1390 2023-11-01T03:18:35.300 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.299+0000 7f5b4f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:35.300 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.299+0000 7f5b4f7fe640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:35.301 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:35.301 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:35.302 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 10 librados: watch_flush enter 2023-11-01T03:18:35.302 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 10 librados: watch_flush exit 2023-11-01T03:18:35.302 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 20 client.4175.objecter shutdown clearing up homeless session... 2023-11-01T03:18:35.303 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 10 client.4175.objecter successfully canceled tick 2023-11-01T03:18:35.303 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 msgr2=0x7f5b5406ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:35.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 0x7f5b5406ec30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5b68070b90 tx=0x7f5b5c009190 comp rx=0 tx=0).stop 2023-11-01T03:18:35.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 10 monclient: shutdown 2023-11-01T03:18:35.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:35.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 msgr2=0x7f5b68144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:35.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.301+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c450 tx=0x7f5b5800c910 comp rx=0 tx=0).stop 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 shutdown_connections 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5b5406c770 0x7f5b5406ec30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6813f160 0x7f5b6806f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b680b4230 0x7f5b6806e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 --2- 172.21.15.5:0/20347421 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5b680b1390 0x7f5b68144c90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:35.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 >> 172.21.15.5:0/20347421 conn(0x7f5b68071920 msgr2=0x7f5b681419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:35.306 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 shutdown_connections 2023-11-01T03:18:35.306 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 -- 172.21.15.5:0/20347421 wait complete. 2023-11-01T03:18:35.306 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:35.302+0000 7f5b6d0a2640 1 librados: shutdown 2023-11-01T03:18:35.313 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-01T03:18:35.553 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:18.093 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:36.096 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:18.620 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:36.279 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:18.811 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:36.477 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:18.987 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:36.670 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:19.192 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.405 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:22.938 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.409 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:22.942 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.809 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:23.349 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.813 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:23.354 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.966 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:23.499 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:40.972 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:23.505 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:41.257 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:23.798 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:41.261 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:23.802 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:41.689 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:24.213 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:41.693 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:24.217 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.118 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:42.146 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:24.678 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.150 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:24.683 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.210 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.208+0000 7f79bbd4c640 10 monclient: get_monmap_and_config 2023-11-01T03:18:42.210 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.208+0000 7f79bbd4c640 10 monclient: build_initial_monmap 2023-11-01T03:18:42.210 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.208+0000 7f79bbd4c640 10 monclient: monmap: 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:42.210660+0000 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:42.210660+0000 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:42.211 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.212 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:42.212 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:42.212 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:42.212 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:42.212 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:42.213 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.214 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.209+0000 7f79bbd4c640 1 Processor -- start 2023-11-01T03:18:42.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.209+0000 7f79bbd4c640 1 -- start start 2023-11-01T03:18:42.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.209+0000 7f79bbd4c640 10 monclient: init 2023-11-01T03:18:42.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:42.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2023-11-01T03:18:42.215 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79b40b4230 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 0x7f79b4141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-a con 0x7f79b413f160 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 0x7f79b4141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-b con 0x7f79b40b1390 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40a9370 con 0x7f79b40b4230 2023-11-01T03:18:42.216 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b4610 con 0x7f79b413f160 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40a9010 con 0x7f79b40b1390 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79bbd4c640 10 monclient(hunting): authenticate will time out at 1398.435136s 2023-11-01T03:18:42.217 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79b92e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 0x7f79b4141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.210+0000 7f79ba2e9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 0x7f79b4141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 0x7f79b4141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50984/0 (socket says 172.21.15.5:50984) 2023-11-01T03:18:42.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 1 -- 172.21.15.5:0/183213722 learned_addr learned my addr 172.21.15.5:0/183213722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:42.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 10 monclient(hunting): get_auth_request con 0x7f79b413f160 auth_method 0 2023-11-01T03:18:42.218 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79b92e7640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79ba2e9640 10 monclient(hunting): get_auth_request con 0x7f79b40b1390 auth_method 0 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79ba2e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79ba2e9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:42.219 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.211+0000 7f79ba2e9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:42.220 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.212+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:42.221 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_done global_id 4178 payload 274 2023-11-01T03:18:42.221 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 1 -- 172.21.15.5:0/183213722 >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 msgr2=0x7f79b4141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 1 --2- 172.21.15.5:0/183213722 >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 0x7f79b4141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 1 -- 172.21.15.5:0/183213722 >> v1:172.21.15.5:6789/0 conn(0x7f79b40b4230 legacy=0x7f79b413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 10 monclient: _finish_hunting 0 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 1 monclient: found mon.noname-b 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:42.222 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:18:42.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.213+0000 7f79ba2e9640 1 -- 172.21.15.5:0/183213722 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40aa4b0 con 0x7f79b40b1390 2023-11-01T03:18:42.223 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.216+0000 7f79ba2e9640 1 --2- 172.21.15.5:0/183213722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 0x7f79b4141cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb20f5e2d55dfff0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:42.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 1 -- 172.21.15.5:0/183213722 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac02cbc0 con 0x7f79b40b1390 2023-11-01T03:18:42.226 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:42.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:42.227 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: dump: 2023-11-01T03:18:42.227 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:42.227 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:42.227 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:42.228 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:42.229 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: _finish_auth 0 2023-11-01T03:18:42.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: _check_auth_tickets 2023-11-01T03:18:42.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:42.229 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 1 -- 172.21.15.5:0/183213722 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac02cd20 con 0x7f79b40b1390 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 5 monclient: authenticate success, global_id 4178 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 1 -- 172.21.15.5:0/183213722 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac034660 con 0x7f79b40b1390 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:18:42.230 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79b8ae6640 10 monclient: dump: 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:42.231 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.232 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:42.232 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:42.232 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:42.232 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.232 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:42.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 4 set_mon_vals no callback set 2023-11-01T03:18:42.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 10 monclient: shutdown 2023-11-01T03:18:42.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:42.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 1 -- 172.21.15.5:0/183213722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 msgr2=0x7f79b4141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.233 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.220+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/183213722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 0x7f79b4141cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac02be10 comp rx=0 tx=0).stop 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 -- 172.21.15.5:0/183213722 shutdown_connections 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/183213722 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b40b1390 0x7f79b4141cb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/183213722 >> v2:172.21.15.5:3300/0 conn(0x7f79b413f160 0x7f79b4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 -- 172.21.15.5:0/183213722 >> 172.21.15.5:0/183213722 conn(0x7f79b4071920 msgr2=0x7f79b4071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 -- 172.21.15.5:0/183213722 shutdown_connections 2023-11-01T03:18:42.234 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 1 -- 172.21.15.5:0/183213722 wait complete. 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 10 monclient: build_initial_monmap 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.221+0000 7f79bbd4c640 10 monclient: monmap: 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:42.235 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:42.236 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:42.236 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.236 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:42.236 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:42.236 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 librados: starting msgr at 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 librados: starting objecter 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 Processor -- start 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 -- start start 2023-11-01T03:18:42.237 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 librados: setting wanted keys 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 librados: calling monclient init 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient: init 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.238 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-b con 0x7f79b40b1390 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79b40b4230 0x7f79b413a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-a con 0x7f79b40b4230 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b413f160 0x7f79b41d98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): picked mon.noname-c con 0x7f79b413f160 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:42.239 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b413be40 con 0x7f79b40b4230 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4139b80 con 0x7f79b40b1390 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4134440 con 0x7f79b413f160 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:42.240 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.222+0000 7f79bbd4c640 10 monclient(hunting): authenticate will time out at 1398.447913s 2023-11-01T03:18:42.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.223+0000 7f79b9ae8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.223+0000 7f79ba2e9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b413f160 0x7f79b41d98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.223+0000 7f79b92e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79b40b4230 0x7f79b413a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:33416/0 (socket says 172.21.15.5:33416) 2023-11-01T03:18:42.241 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 1 -- 172.21.15.5:0/1378498423 learned_addr learned my addr 172.21.15.5:0/1378498423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): get_auth_request con 0x7f79b40b1390 auth_method 0 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): get_auth_request con 0x7f79b413f160 auth_method 0 2023-11-01T03:18:42.242 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): get_auth_request con 0x7f79b40b4230 auth_method 0 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:42.243 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b9ae8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:42.244 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79b92e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:42.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:42.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:42.245 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.224+0000 7f79ba2e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:42.246 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 10 monclient(hunting): handle_auth_done global_id 4234 payload 824 2023-11-01T03:18:42.247 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 -- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b413f160 msgr2=0x7f79b41d98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.247 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b413f160 0x7f79b41d98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.247 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 -- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79b40b4230 msgr2=0x7f79b413a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.247 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79b40b4230 0x7f79b413a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.247 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 10 monclient: _finish_hunting 0 2023-11-01T03:18:42.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 monclient: found mon.noname-b 2023-11-01T03:18:42.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:42.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:18:42.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.228+0000 7f79b9ae8640 1 -- 172.21.15.5:0/1378498423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009a70 con 0x7f79b40b1390 2023-11-01T03:18:42.248 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.231+0000 7f79b9ae8640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c450 tx=0x7f79b000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.231+0000 7f79aa7fc640 10 client.?.objecter ms_handle_connect 0x7f79b40b1390 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.231+0000 7f79aa7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00052d0 con 0x7f79b40b1390 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:18:42.249 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 10 monclient: dump: 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:42.250 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 10 monclient: _finish_auth 0 2023-11-01T03:18:42.251 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:18:42.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:42.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 5 monclient: authenticate success, global_id 4234 2023-11-01T03:18:42.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 10 monclient: _renew_subs 2023-11-01T03:18:42.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:42.252 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b413af30 con 0x7f79b40b1390 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 10 client.4234.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 10 monclient: _renew_subs 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b41d9e10 con 0x7f79b40b1390 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.234+0000 7f79bbd4c640 1 librados: init done 2023-11-01T03:18:42.253 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.235+0000 7f79bbd4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:42.254 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.235+0000 7f79bbd4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:42.254 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.235+0000 7f79bbd4c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:42.254 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.235+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40b5da0 con 0x7f79b40b1390 2023-11-01T03:18:42.371 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:24.882 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.375 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:24.886 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.386 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:24.908 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.390 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:24.913 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:42.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00011e0 con 0x7f79b40b1390 2023-11-01T03:18:42.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:42.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0007030 con 0x7f79b40b1390 2023-11-01T03:18:42.672 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79aa7fc640 10 monclient: dump: 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.673 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:42.674 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:42.674 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:42.674 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:42.674 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:42.674 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:42.675 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:42.675 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.670+0000 7f79abfff640 4 set_mon_vals no callback set 2023-11-01T03:18:42.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.671+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f79b0007250 con 0x7f79b40b1390 2023-11-01T03:18:42.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.672+0000 7f79aa7fc640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 0x7f799806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:42.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.672+0000 7f79b92e7640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 0x7f799806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:42.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.672+0000 7f79b92e7640 10 monclient: get_auth_request con 0x7f799806c770 auth_method 0 2023-11-01T03:18:42.676 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.672+0000 7f79aa7fc640 10 client.4234.objecter ms_handle_connect 0x7f799806c770 2023-11-01T03:18:42.677 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.672+0000 7f79b92e7640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 0x7f799806ec30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79b4138770 tx=0x7f79a4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:42.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.686+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f79b0058950 con 0x7f79b40b1390 2023-11-01T03:18:42.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.686+0000 7f79aa7fc640 10 client.4234.objecter ms_dispatch 0x7f79b4000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:42.688 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.686+0000 7f79aa7fc640 3 client.4234.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:42.689 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.686+0000 7f79aa7fc640 3 client.4234.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:42.689 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.686+0000 7f79aa7fc640 20 client.4234.objecter dump_active .. 0 homeless 2023-11-01T03:18:42.689 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.687+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79b0054c90 con 0x7f79b40b1390 2023-11-01T03:18:42.689 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.687+0000 7f79aa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:42.690 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.687+0000 7f79aa7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:42.875 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.874+0000 7f79bbd4c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:42.876 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.874+0000 7f79bbd4c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:42.876 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.874+0000 7f79bbd4c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:18:42.876 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.874+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79b4139d90 con 0x7f79b40b1390 2023-11-01T03:18:42.894 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.892+0000 7f79aa7fc640 1 -- 172.21.15.5:0/1378498423 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f79b00582b0 con 0x7f79b40b1390 2023-11-01T03:18:42.894 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.892+0000 7f79aa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:42.894 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.892+0000 7f79aa7fc640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:42.894 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:42.894 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:42.897 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 10 librados: watch_flush enter 2023-11-01T03:18:42.897 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 10 librados: watch_flush exit 2023-11-01T03:18:42.897 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 20 client.4234.objecter shutdown clearing up homeless session... 2023-11-01T03:18:42.897 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 10 client.4234.objecter successfully canceled tick 2023-11-01T03:18:42.898 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 msgr2=0x7f799806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.898 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 0x7f799806ec30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79b4138770 tx=0x7f79a4009240 comp rx=0 tx=0).stop 2023-11-01T03:18:42.898 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 10 monclient: shutdown 2023-11-01T03:18:42.898 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:42.898 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 msgr2=0x7f79b4137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:42.899 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c450 tx=0x7f79b000c910 comp rx=0 tx=0).stop 2023-11-01T03:18:42.899 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 shutdown_connections 2023-11-01T03:18:42.899 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f799806c770 0x7f799806ec30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.899 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f79b413f160 0x7f79b41d98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.899 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79b40b4230 0x7f79b413a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.900 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 --2- 172.21.15.5:0/1378498423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79b40b1390 0x7f79b4137f30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:42.900 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 >> 172.21.15.5:0/1378498423 conn(0x7f79b4071920 msgr2=0x7f79b40b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:42.900 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 shutdown_connections 2023-11-01T03:18:42.900 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.894+0000 7f79bbd4c640 1 -- 172.21.15.5:0/1378498423 wait complete. 2023-11-01T03:18:42.900 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:42.895+0000 7f79bbd4c640 1 librados: shutdown 2023-11-01T03:18:42.907 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-01T03:18:44.865 INFO:tasks.ceph.osd.6.smithi153.stderr:==00:00:00:27.398 86058== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:45.219 INFO:tasks.ceph.osd.4.smithi153.stderr:==00:00:00:27.759 86055== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:45.224 INFO:tasks.ceph.osd.5.smithi153.stderr:==00:00:00:27.764 86056== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:45.514 INFO:tasks.ceph.osd.7.smithi153.stderr:==00:00:00:28.047 86057== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:46.131 INFO:tasks.ceph.osd.0.smithi005.stderr:==00:00:00:28.655 86463== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:46.589 INFO:tasks.ceph.osd.1.smithi005.stderr:==00:00:00:29.121 86454== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:46.611 INFO:tasks.ceph.osd.2.smithi005.stderr:==00:00:00:29.133 86464== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:47.014 INFO:tasks.ceph.osd.3.smithi005.stderr:==00:00:00:29.525 86471== Warning: unimplemented fcntl command: 1038 2023-11-01T03:18:49.713 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:49.845 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.844+0000 7f78870bb640 10 monclient: get_monmap_and_config 2023-11-01T03:18:49.845 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.844+0000 7f78870bb640 10 monclient: build_initial_monmap 2023-11-01T03:18:49.845 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.844+0000 7f78870bb640 10 monclient: monmap: 2023-11-01T03:18:49.846 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:49.846 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:49.846 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:49.845316+0000 2023-11-01T03:18:49.846 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:49.845316+0000 2023-11-01T03:18:49.846 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:49.847 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.847 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:49.847 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:49.847 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:49.847 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:49.848 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:49.848 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.850 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.845+0000 7f78870bb640 1 Processor -- start 2023-11-01T03:18:49.850 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.846+0000 7f78870bb640 1 -- start start 2023-11-01T03:18:49.850 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.846+0000 7f78870bb640 10 monclient: init 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.846+0000 7f78870bb640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.846+0000 7f78870bb640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f788013eea0 addr v1:172.21.15.5:6789/0 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f78800aea30 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f788014b140 0x7f788014d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:49.851 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-c con 0x7f788014b140 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800b14b0 con 0x7f788013eea0 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7880145180 con 0x7f78800aea30 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800affe0 con 0x7f788014b140 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:49.852 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.847+0000 7f78870bb640 10 monclient(hunting): authenticate will time out at 1406.071053s 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.848+0000 7f7885658640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f788014b140 0x7f788014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7877fff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f78800aea30 0x7f78800b0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:47614/0 (socket says 172.21.15.5:47614) 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7877fff640 1 -- 172.21.15.5:0/271045869 learned_addr learned my addr 172.21.15.5:0/271045869 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7885658640 10 monclient(hunting): get_auth_request con 0x7f788014b140 auth_method 0 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7885658640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:49.853 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7885658640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:49.854 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.849+0000 7f7885658640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:49.854 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.850+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:49.854 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.850+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:49.855 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.850+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:49.856 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 10 monclient(hunting): handle_auth_done global_id 4237 payload 274 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 1 -- 172.21.15.5:0/271045869 >> v1:172.21.15.153:6789/0 conn(0x7f78800aea30 legacy=0x7f78800b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 1 -- 172.21.15.5:0/271045869 >> v1:172.21.15.5:6789/0 conn(0x7f788013eea0 legacy=0x7f78800b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 10 monclient: _finish_hunting 0 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 1 monclient: found mon.noname-c 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:49.857 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:18:49.858 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.855+0000 7f7885658640 1 -- 172.21.15.5:0/271045869 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800b0880 con 0x7f788014b140 2023-11-01T03:18:49.865 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.865+0000 7f7885658640 1 --2- 172.21.15.5:0/271045869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f788014b140 0x7f788014d530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7878009d90 tx=0x7f787802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924d6f20ea426427 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:49.940 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 1 -- 172.21.15.5:0/271045869 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787802cbd0 con 0x7f788014b140 2023-11-01T03:18:49.940 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:49.940 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 10 monclient: dump: 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.941 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:49.942 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.942 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:49.942 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:49.942 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:49.942 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 10 monclient: _finish_auth 0 2023-11-01T03:18:49.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 10 monclient: _check_auth_tickets 2023-11-01T03:18:49.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:49.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78870bb640 5 monclient: authenticate success, global_id 4237 2023-11-01T03:18:49.943 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.939+0000 7f78870bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:49.945 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 1 -- 172.21.15.5:0/271045869 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787802cd30 con 0x7f788014b140 2023-11-01T03:18:49.945 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:49.945 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 1 -- 172.21.15.5:0/271045869 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787802cea0 con 0x7f788014b140 2023-11-01T03:18:49.945 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:49.946 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:18:49.946 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78777fe640 10 monclient: dump: 2023-11-01T03:18:49.946 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:49.946 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:49.946 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:49.947 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:49.948 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.948 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78870bb640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:49.948 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.944+0000 7f78870bb640 4 set_mon_vals no callback set 2023-11-01T03:18:49.951 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 10 monclient: shutdown 2023-11-01T03:18:49.951 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:49.951 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 -- 172.21.15.5:0/271045869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f788014b140 msgr2=0x7f788014d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:49.952 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 --2- 172.21.15.5:0/271045869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f788014b140 0x7f788014d530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7878009d90 tx=0x7f787802be20 comp rx=0 tx=0).stop 2023-11-01T03:18:49.952 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 -- 172.21.15.5:0/271045869 shutdown_connections 2023-11-01T03:18:49.952 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 --2- 172.21.15.5:0/271045869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f788014b140 0x7f788014d530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:49.952 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 -- 172.21.15.5:0/271045869 >> 172.21.15.5:0/271045869 conn(0x7f78800716e0 msgr2=0x7f7880071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:49.952 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 -- 172.21.15.5:0/271045869 shutdown_connections 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.945+0000 7f78870bb640 1 -- 172.21.15.5:0/271045869 wait complete. 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 10 monclient: build_initial_monmap 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 10 monclient: monmap: 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:49.953 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:49.954 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:49.954 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:49.954 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.954 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:49.954 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 librados: starting msgr at 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 librados: starting objecter 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 Processor -- start 2023-11-01T03:18:49.955 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 -- start start 2023-11-01T03:18:49.956 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 librados: setting wanted keys 2023-11-01T03:18:49.956 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 1 librados: calling monclient init 2023-11-01T03:18:49.956 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.946+0000 7f78870bb640 10 monclient: init 2023-11-01T03:18:49.956 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:49.956 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 0x7f78800a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-b con 0x7f78800aea30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 0x7f78801da950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-a con 0x7f788013eea0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f788014b140 0x7f78800ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:49.957 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): picked mon.noname-c con 0x7f788014b140 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:49.958 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:49.958 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800acd30 con 0x7f788013eea0 2023-11-01T03:18:49.958 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:49.958 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78801da4c0 con 0x7f78800aea30 2023-11-01T03:18:49.958 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:49.959 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78801dae90 con 0x7f788014b140 2023-11-01T03:18:49.959 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:49.959 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.947+0000 7f78870bb640 10 monclient(hunting): authenticate will time out at 1406.171820s 2023-11-01T03:18:49.959 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.948+0000 7f7877fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 0x7f78801da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:49.959 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.948+0000 7f7884e57640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 0x7f78800a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.948+0000 7f7885658640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f788014b140 0x7f78800ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 0x7f78800a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:58626/0 (socket says 172.21.15.5:58626) 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 1 -- 172.21.15.5:0/1329989342 learned_addr learned my addr 172.21.15.5:0/1329989342 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): get_auth_request con 0x7f78800aea30 auth_method 0 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:49.960 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): get_auth_request con 0x7f788013eea0 auth_method 0 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:49.961 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7885658640 10 monclient(hunting): get_auth_request con 0x7f788014b140 auth_method 0 2023-11-01T03:18:49.962 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7885658640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:49.962 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7885658640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:49.962 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7885658640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:49.962 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:49.962 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7884e57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.949+0000 7f7877fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.950+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:49.963 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.950+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:49.964 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.950+0000 7f7885658640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:49.965 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.952+0000 7f7877fff640 10 monclient(hunting): handle_auth_done global_id 4200 payload 824 2023-11-01T03:18:49.965 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 -- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f788014b140 msgr2=0x7f78800ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:49.966 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f788014b140 0x7f78800ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:49.966 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 -- 172.21.15.5:0/1329989342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 msgr2=0x7f78800a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:49.966 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 0x7f78800a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:49.966 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 10 monclient: _finish_hunting 0 2023-11-01T03:18:49.966 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 monclient: found mon.noname-a 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.953+0000 7f7877fff640 1 -- 172.21.15.5:0/1329989342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009a70 con 0x7f788013eea0 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.955+0000 7f78757fa640 10 client.?.objecter ms_handle_connect 0x7f788013eea0 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.955+0000 7f78757fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:49.967 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.955+0000 7f7877fff640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 0x7f78801da950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f787000c440 tx=0x7f787000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:49.968 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870005ce0 con 0x7f788013eea0 2023-11-01T03:18:49.968 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:49.968 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:49.968 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: dump: 2023-11-01T03:18:49.968 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:49.969 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:49.969 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.969 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.969 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:49.969 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.970 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:49.970 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:49.970 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:49.970 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.970 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: _finish_auth 0 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: _check_auth_tickets 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870005e40 con 0x7f788013eea0 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700072d0 con 0x7f788013eea0 2023-11-01T03:18:49.971 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:49.972 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:49.972 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78757fa640 10 monclient: dump: 2023-11-01T03:18:49.972 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:49.972 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:49.972 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:49.973 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:49.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 5 monclient: authenticate success, global_id 4200 2023-11-01T03:18:49.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f7876ffd640 4 set_mon_vals no callback set 2023-11-01T03:18:49.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 10 monclient: _renew_subs 2023-11-01T03:18:49.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:49.974 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78801da050 con 0x7f788013eea0 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 10 client.4200.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 10 monclient: _renew_subs 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78800ab960 con 0x7f788013eea0 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.960+0000 7f78870bb640 1 librados: init done 2023-11-01T03:18:49.975 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.961+0000 7f78870bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:49.976 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.961+0000 7f78870bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:49.976 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.961+0000 7f78870bb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:49.976 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.961+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78801da650 con 0x7f788013eea0 2023-11-01T03:18:49.982 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.981+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f7870007430 con 0x7f788013eea0 2023-11-01T03:18:49.983 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.982+0000 7f78757fa640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 0x7f786c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:49.986 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.982+0000 7f7884e57640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 0x7f786c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:49.986 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.982+0000 7f7884e57640 10 monclient: get_auth_request con 0x7f786c06c770 auth_method 0 2023-11-01T03:18:49.986 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.983+0000 7f7884e57640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 0x7f786c06ec30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f787c001840 tx=0x7f787c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:49.986 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:49.983+0000 7f78757fa640 10 client.4200.objecter ms_handle_connect 0x7f786c06c770 2023-11-01T03:18:50.009 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.008+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7870057ca0 con 0x7f788013eea0 2023-11-01T03:18:50.010 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.008+0000 7f78757fa640 10 client.4200.objecter ms_dispatch 0x7f7880000b90 osd_map(10..10 src has 1..10) v4 2023-11-01T03:18:50.010 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.008+0000 7f78757fa640 3 client.4200.objecter handle_osd_map got epochs [10,10] > 0 2023-11-01T03:18:50.010 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.008+0000 7f78757fa640 3 client.4200.objecter handle_osd_map decoding full epoch 10 2023-11-01T03:18:50.010 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.008+0000 7f78757fa640 20 client.4200.objecter dump_active .. 0 homeless 2023-11-01T03:18:50.320 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.319+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7870053fe0 con 0x7f788013eea0 2023-11-01T03:18:50.320 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.319+0000 7f78757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:50.320 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.319+0000 7f78757fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:50.604 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.603+0000 7f78870bb640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:50.604 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.603+0000 7f78870bb640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:50.604 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.603+0000 7f78870bb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:50.604 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.603+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78801da240 con 0x7f788013eea0 2023-11-01T03:18:50.661 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.660+0000 7f78757fa640 1 -- 172.21.15.5:0/1329989342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7870017090 con 0x7f788013eea0 2023-11-01T03:18:50.661 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.660+0000 7f78757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:50.661 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.660+0000 7f78757fa640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:50.662 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:50.662 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:17.007564+0000","last_up_change":"0.000000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:50.664 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.662+0000 7f78870bb640 10 librados: watch_flush enter 2023-11-01T03:18:50.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 10 librados: watch_flush exit 2023-11-01T03:18:50.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 20 client.4200.objecter shutdown clearing up homeless session... 2023-11-01T03:18:50.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 10 client.4200.objecter successfully canceled tick 2023-11-01T03:18:50.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 msgr2=0x7f786c06ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:50.665 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 0x7f786c06ec30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f787c001840 tx=0x7f787c009040 comp rx=0 tx=0).stop 2023-11-01T03:18:50.666 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 10 monclient: shutdown 2023-11-01T03:18:50.666 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:50.666 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 msgr2=0x7f78801da950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:50.666 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 0x7f78801da950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f787000c440 tx=0x7f787000c900 comp rx=0 tx=0).stop 2023-11-01T03:18:50.666 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 shutdown_connections 2023-11-01T03:18:50.667 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f786c06c770 0x7f786c06ec30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:50.667 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f788014b140 0x7f78800ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:50.667 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788013eea0 0x7f78801da950 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:50.667 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 --2- 172.21.15.5:0/1329989342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78800aea30 0x7f78800a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:50.667 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 >> 172.21.15.5:0/1329989342 conn(0x7f78800716e0 msgr2=0x7f7880143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:50.668 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 shutdown_connections 2023-11-01T03:18:50.668 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 -- 172.21.15.5:0/1329989342 wait complete. 2023-11-01T03:18:50.668 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:50.663+0000 7f78870bb640 1 librados: shutdown 2023-11-01T03:18:50.678 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-01T03:18:52.965 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:18:52.960+0000 5dc2340 -1 osd.6 0 log_to_monitors true 2023-11-01T03:18:53.215 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:18:53.211+0000 5dc2340 -1 osd.4 0 log_to_monitors true 2023-11-01T03:18:53.528 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:18:53.525+0000 5dc2340 -1 osd.5 0 log_to_monitors true 2023-11-01T03:18:53.757 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:18:53.752+0000 5dc2340 -1 osd.7 0 log_to_monitors true 2023-11-01T03:18:55.000 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:18:54.996+0000 5dc2340 -1 osd.0 0 log_to_monitors true 2023-11-01T03:18:55.434 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:18:55.431+0000 5dc2340 -1 osd.1 0 log_to_monitors true 2023-11-01T03:18:55.702 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:18:55.698+0000 5dc2340 -1 osd.2 0 log_to_monitors true 2023-11-01T03:18:56.081 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:18:56.078+0000 5dc2340 -1 osd.3 0 log_to_monitors true 2023-11-01T03:18:56.152 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:18:56.146+0000 c495640 -1 osd.4 0 waiting for initial osdmap 2023-11-01T03:18:56.227 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:18:56.215+0000 c495640 -1 osd.6 0 waiting for initial osdmap 2023-11-01T03:18:56.594 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:18:56.579+0000 1125d640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:56.604 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:18:56.589+0000 10a5c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:57.294 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:18:57.290+0000 ac7d640 -1 osd.7 0 waiting for initial osdmap 2023-11-01T03:18:57.415 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:18:57.410+0000 c495640 -1 osd.5 0 waiting for initial osdmap 2023-11-01T03:18:57.485 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:18:57.576 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.575+0000 7f982e14c640 10 monclient: get_monmap_and_config 2023-11-01T03:18:57.577 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.575+0000 7f982e14c640 10 monclient: build_initial_monmap 2023-11-01T03:18:57.577 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.575+0000 7f982e14c640 10 monclient: monmap: 2023-11-01T03:18:57.577 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:57.577 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:57.578 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:18:57.576807+0000 2023-11-01T03:18:57.578 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:18:57.576807+0000 2023-11-01T03:18:57.578 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:57.578 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.578 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:18:57.579 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:18:57.579 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:18:57.579 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:18:57.579 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:18:57.579 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.581 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.576+0000 7f982e14c640 1 Processor -- start 2023-11-01T03:18:57.582 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.576+0000 7f982e14c640 1 -- start start 2023-11-01T03:18:57.582 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.576+0000 7f982e14c640 10 monclient: init 2023-11-01T03:18:57.582 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:57.582 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2023-11-01T03:18:57.583 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f982813eea0 addr v1:172.21.15.153:6789/0 2023-11-01T03:18:57.583 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98280aea30 0x7f98280b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.583 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-a con 0x7f98280aea30 addr v2:172.21.15.5:3300/0 2023-11-01T03:18:57.583 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f982814a130 0x7f982814c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.583 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-c con 0x7f982814a130 addr v2:172.21.15.153:3300/0 2023-11-01T03:18:57.584 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9828145180 con 0x7f982813eea0 2023-11-01T03:18:57.584 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:57.584 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98280affe0 con 0x7f98280aea30 2023-11-01T03:18:57.584 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:57.584 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98280b0880 con 0x7f982814a130 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f982e14c640 10 monclient(hunting): authenticate will time out at 1413.801352s 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f9826ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98280aea30 0x7f98280b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.577+0000 7f9827fff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f982814a130 0x7f982814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98280aea30 0x7f98280b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49592/0 (socket says 172.21.15.5:49592) 2023-11-01T03:18:57.585 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 1 -- 172.21.15.5:0/3347434540 learned_addr learned my addr 172.21.15.5:0/3347434540 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:57.586 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): get_auth_request con 0x7f98280aea30 auth_method 0 2023-11-01T03:18:57.586 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:57.586 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:57.586 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9827fff640 10 monclient(hunting): get_auth_request con 0x7f982814a130 auth_method 0 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9827fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9827fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9827fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:57.587 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:57.588 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.578+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:57.588 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.579+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:57.588 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.579+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:57.588 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.579+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:57.588 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 10 monclient(hunting): handle_auth_done global_id 4224 payload 274 2023-11-01T03:18:57.589 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 1 -- 172.21.15.5:0/3347434540 >> v2:172.21.15.153:3300/0 conn(0x7f982814a130 msgr2=0x7f982814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:57.589 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 1 --2- 172.21.15.5:0/3347434540 >> v2:172.21.15.153:3300/0 conn(0x7f982814a130 0x7f982814c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.589 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 1 -- 172.21.15.5:0/3347434540 >> v1:172.21.15.153:6789/0 conn(0x7f982813eea0 legacy=0x7f98280b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:18:57.589 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 10 monclient: _finish_hunting 0 2023-11-01T03:18:57.589 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 1 monclient: found mon.noname-a 2023-11-01T03:18:57.590 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:57.590 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:57.590 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.580+0000 7f9826ffd640 1 -- 172.21.15.5:0/3347434540 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280b37d0 con 0x7f98280aea30 2023-11-01T03:18:57.593 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.582+0000 7f9826ffd640 1 --2- 172.21.15.5:0/3347434540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98280aea30 0x7f98280b0da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98280b3570 tx=0x7f981c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b860e968e534af server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:57.594 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 1 -- 172.21.15.5:0/3347434540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c031750 con 0x7f98280aea30 2023-11-01T03:18:57.594 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:57.594 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:57.594 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: dump: 2023-11-01T03:18:57.594 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.595 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:57.596 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:57.596 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:57.596 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.596 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: _finish_auth 0 2023-11-01T03:18:57.596 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: _check_auth_tickets 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 1 -- 172.21.15.5:0/3347434540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0318b0 con 0x7f98280aea30 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f982e14c640 5 monclient: authenticate success, global_id 4224 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f982e14c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:57.597 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 1 -- 172.21.15.5:0/3347434540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c031c40 con 0x7f98280aea30 2023-11-01T03:18:57.598 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:57.598 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:57.598 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f98267fc640 10 monclient: dump: 2023-11-01T03:18:57.598 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.599 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:57.600 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:57.600 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:57.600 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.600 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f982e14c640 10 monclient: get_monmap_and_config success 2023-11-01T03:18:57.600 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.585+0000 7f982e14c640 4 set_mon_vals no callback set 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 10 monclient: shutdown 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 -- 172.21.15.5:0/3347434540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98280aea30 msgr2=0x7f98280b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 --2- 172.21.15.5:0/3347434540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98280aea30 0x7f98280b0da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98280b3570 tx=0x7f981c02b7f0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 -- 172.21.15.5:0/3347434540 shutdown_connections 2023-11-01T03:18:57.601 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 --2- 172.21.15.5:0/3347434540 >> v2:172.21.15.153:3300/0 conn(0x7f982814a130 0x7f982814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.602 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 --2- 172.21.15.5:0/3347434540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98280aea30 0x7f98280b0da0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.602 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 -- 172.21.15.5:0/3347434540 >> 172.21.15.5:0/3347434540 conn(0x7f98280716e0 msgr2=0x7f9828071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:57.602 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 -- 172.21.15.5:0/3347434540 shutdown_connections 2023-11-01T03:18:57.602 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.586+0000 7f982e14c640 1 -- 172.21.15.5:0/3347434540 wait complete. 2023-11-01T03:18:57.602 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 10 monclient: build_initial_monmap 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 10 monclient: monmap: 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:18:57.603 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.604 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 librados: starting msgr at 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 librados: starting objecter 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 Processor -- start 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 -- start start 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 librados: setting wanted keys 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 1 librados: calling monclient init 2023-11-01T03:18:57.605 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.587+0000 7f982e14c640 10 monclient: init 2023-11-01T03:18:57.606 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient: _reopen_session rank -1 2023-11-01T03:18:57.606 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:18:57.606 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98280aea30 0x7f9828141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.606 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-b con 0x7f98280aea30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:18:57.606 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-a con 0x7f982813eea0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f982814a130 0x7f98281d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): picked mon.noname-c con 0x7f982814a130 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280a8ab0 con 0x7f982813eea0 2023-11-01T03:18:57.607 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828148c70 con 0x7f98280aea30 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828148e00 con 0x7f982814a130 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): _renew_subs 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f982e14c640 10 monclient(hunting): authenticate will time out at 1413.812333s 2023-11-01T03:18:57.608 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f9826ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.609 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.588+0000 7f9827fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f982814a130 0x7f98281d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.609 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98280aea30 0x7f9828141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.609 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49594/0 (socket says 172.21.15.5:49594) 2023-11-01T03:18:57.609 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 1 -- 172.21.15.5:0/3641216915 learned_addr learned my addr 172.21.15.5:0/3641216915 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:18:57.609 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): get_auth_request con 0x7f982813eea0 auth_method 0 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): get_auth_request con 0x7f98280aea30 auth_method 0 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:57.610 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): get_auth_request con 0x7f982814a130 auth_method 0 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:18:57.611 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:57.612 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:57.612 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9826ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:57.612 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:57.612 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:57.612 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f98277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.589+0000 7f9827fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 10 monclient(hunting): handle_auth_done global_id 4227 payload 824 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 -- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f982814a130 msgr2=0x7f98281d6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:57.613 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f982814a130 0x7f98281d6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.614 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 -- 172.21.15.5:0/3641216915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98280aea30 msgr2=0x7f9828141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:57.614 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98280aea30 0x7f9828141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:57.614 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 10 monclient: _finish_hunting 0 2023-11-01T03:18:57.614 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 monclient: found mon.noname-a 2023-11-01T03:18:57.614 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:18:57.615 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:18:57.615 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.592+0000 7f9826ffd640 1 -- 172.21.15.5:0/3641216915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0094d0 con 0x7f982813eea0 2023-11-01T03:18:57.616 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.594+0000 7f9826ffd640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f981c0090b0 tx=0x7f981c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:57.617 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.594+0000 7f980ffff640 10 client.?.objecter ms_handle_connect 0x7f982813eea0 2023-11-01T03:18:57.617 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.594+0000 7f980ffff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:18:57.617 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c033a10 con 0x7f982813eea0 2023-11-01T03:18:57.617 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:57.617 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:18:57.618 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: dump: 2023-11-01T03:18:57.618 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:57.618 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:57.618 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.618 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.619 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:57.619 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.619 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:57.619 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:57.619 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:57.620 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.620 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: _finish_auth 0 2023-11-01T03:18:57.620 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: _check_auth_tickets 2023-11-01T03:18:57.620 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:18:57.620 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 5 monclient: authenticate success, global_id 4227 2023-11-01T03:18:57.621 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c033b90 con 0x7f982813eea0 2023-11-01T03:18:57.621 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:18:57.621 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 10 monclient: _renew_subs 2023-11-01T03:18:57.621 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c03c400 con 0x7f982813eea0 2023-11-01T03:18:57.621 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:57.622 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9828148030 con 0x7f982813eea0 2023-11-01T03:18:57.622 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:18:57.622 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:18:57.622 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f980ffff640 10 monclient: dump: 2023-11-01T03:18:57.622 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:18:57.623 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:18:57.624 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:18:57.624 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:18:57.624 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:18:57.624 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f9825ffb640 4 set_mon_vals no callback set 2023-11-01T03:18:57.624 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 10 client.4227.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 10 monclient: _renew_subs 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828149d60 con 0x7f982813eea0 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.598+0000 7f982e14c640 1 librados: init done 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.599+0000 7f982e14c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:57.625 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.599+0000 7f982e14c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:57.626 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.599+0000 7f982e14c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:57.626 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.599+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9828149170 con 0x7f982813eea0 2023-11-01T03:18:57.627 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.618+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f981c03a040 con 0x7f982813eea0 2023-11-01T03:18:57.627 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.619+0000 7f980ffff640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 0x7f981406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:18:57.627 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.619+0000 7f98277fe640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 0x7f981406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.619+0000 7f98277fe640 10 monclient: get_auth_request con 0x7f981406c7c0 auth_method 0 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.619+0000 7f980ffff640 10 client.4227.objecter ms_handle_connect 0x7f981406c7c0 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.619+0000 7f98277fe640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 0x7f981406ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9818004f60 tx=0x7f9818007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.621+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2575+0+0 (secure 0 0 0) 0x7f981c07a430 con 0x7f982813eea0 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.621+0000 7f980ffff640 10 client.4227.objecter ms_dispatch 0x7f9828000b90 osd_map(13..13 src has 1..13) v4 2023-11-01T03:18:57.628 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.621+0000 7f980ffff640 3 client.4227.objecter handle_osd_map got epochs [13,13] > 0 2023-11-01T03:18:57.629 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.621+0000 7f980ffff640 3 client.4227.objecter handle_osd_map decoding full epoch 13 2023-11-01T03:18:57.629 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.621+0000 7f980ffff640 20 client.4227.objecter dump_active .. 0 homeless 2023-11-01T03:18:57.755 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:18:57.741+0000 10a5c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:57.888 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.878+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f981c076770 con 0x7f982813eea0 2023-11-01T03:18:57.889 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.878+0000 7f980ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:18:57.889 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:57.878+0000 7f980ffff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:18:57.889 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:18:57.851+0000 1125d640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:58.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.069+0000 7f982e14c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:58.070 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.069+0000 7f982e14c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:58.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.069+0000 7f982e14c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:18:58.071 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.069+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98280b2dc0 con 0x7f982813eea0 2023-11-01T03:18:58.108 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.107+0000 7f980ffff640 1 -- 172.21.15.5:0/3641216915 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8040 (secure 0 0 0) 0x7f981c079d90 con 0x7f982813eea0 2023-11-01T03:18:58.108 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.107+0000 7f980ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:18:58.109 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.107+0000 7f980ffff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:18:58.109 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:18:58.109 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":13,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:18:56.889605+0000","last_up_change":"2023-11-01T03:18:56.889605+0000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6825","nonce":439822656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6827","nonce":439822656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6831","nonce":439822656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6829","nonce":439822656}]},"public_addr":"172.21.15.153:6825/439822656","cluster_addr":"172.21.15.153:6827/439822656","heartbeat_back_addr":"172.21.15.153:6831/439822656","heartbeat_front_addr":"172.21.15.153:6829/439822656","state":["exists","up"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6801","nonce":1447491004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6803","nonce":1447491004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6807","nonce":1447491004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6805","nonce":1447491004}]},"public_addr":"172.21.15.153:6801/1447491004","cluster_addr":"172.21.15.153:6803/1447491004","heartbeat_back_addr":"172.21.15.153:6807/1447491004","heartbeat_front_addr":"172.21.15.153:6805/1447491004","state":["exists","up"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:18:58.111 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 10 librados: watch_flush enter 2023-11-01T03:18:58.111 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 10 librados: watch_flush exit 2023-11-01T03:18:58.111 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 20 client.4227.objecter shutdown clearing up homeless session... 2023-11-01T03:18:58.112 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 10 client.4227.objecter successfully canceled tick 2023-11-01T03:18:58.112 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 msgr2=0x7f981406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:58.112 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.109+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 0x7f981406ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9818004f60 tx=0x7f9818007e30 comp rx=0 tx=0).stop 2023-11-01T03:18:58.112 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 10 monclient: shutdown 2023-11-01T03:18:58.112 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:18:58.113 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 msgr2=0x7f98281d67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:18:58.113 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f981c0090b0 tx=0x7f981c0046c0 comp rx=0 tx=0).stop 2023-11-01T03:18:58.113 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 shutdown_connections 2023-11-01T03:18:58.113 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f981406c7c0 0x7f981406ec80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:58.113 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f982814a130 0x7f98281d6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:58.114 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f982813eea0 0x7f98281d67d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:58.114 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 --2- 172.21.15.5:0/3641216915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98280aea30 0x7f9828141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:18:58.114 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 >> 172.21.15.5:0/3641216915 conn(0x7f98280716e0 msgr2=0x7f98280b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:18:58.114 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 shutdown_connections 2023-11-01T03:18:58.114 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 -- 172.21.15.5:0/3641216915 wait complete. 2023-11-01T03:18:58.115 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:18:58.110+0000 7f982e14c640 1 librados: shutdown 2023-11-01T03:18:58.120 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-11-01T03:18:58.562 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:18:58.557+0000 c495640 -1 osd.1 0 waiting for initial osdmap 2023-11-01T03:18:58.627 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:18:58.624+0000 c495640 -1 osd.0 0 waiting for initial osdmap 2023-11-01T03:18:59.023 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:18:59.009+0000 1225f640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:59.127 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:18:59.113+0000 11a5e640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:18:59.530 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:18:59.525+0000 c495640 -1 osd.3 0 waiting for initial osdmap 2023-11-01T03:18:59.667 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:18:59.663+0000 c495640 -1 osd.2 0 waiting for initial osdmap 2023-11-01T03:19:00.097 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:19:00.083+0000 11a5e640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:19:00.133 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:19:00.119+0000 1225f640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-01T03:19:04.926 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-01T03:19:05.017 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.016+0000 7fc2c1421640 10 monclient: get_monmap_and_config 2023-11-01T03:19:05.018 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.016+0000 7fc2c1421640 10 monclient: build_initial_monmap 2023-11-01T03:19:05.018 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.017+0000 7fc2c1421640 10 monclient: monmap: 2023-11-01T03:19:05.018 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:19:05.018 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:05.019 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:19:05.017906+0000 2023-11-01T03:19:05.019 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:19:05.017906+0000 2023-11-01T03:19:05.019 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:05.019 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.019 INFO:teuthology.misc.health.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:05.020 INFO:teuthology.misc.health.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:05.020 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:05.020 INFO:teuthology.misc.health.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:05.020 INFO:teuthology.misc.health.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:05.020 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.017+0000 7fc2c1421640 1 Processor -- start 2023-11-01T03:19:05.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.017+0000 7fc2c1421640 1 -- start start 2023-11-01T03:19:05.023 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.017+0000 7fc2c1421640 10 monclient: init 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc13eea0 0x7fc2bc0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-b con 0x7fc2bc13eea0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2bc0b3e50 0x7fc2bc0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.024 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-c con 0x7fc2bc0b3e50 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc2bc0b19e0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2bc0aef70 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2bc145180 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:05.025 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc0affe0 con 0x7fc2bc13eea0 2023-11-01T03:19:05.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:05.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2c1421640 10 monclient(hunting): authenticate will time out at 1421.242325s 2023-11-01T03:19:05.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2bb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2bc0b19e0 0x7fc2bc0b1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45884/0 (socket says 172.21.15.5:45884) 2023-11-01T03:19:05.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2bb7fe640 1 -- 172.21.15.5:0/334901478 learned_addr learned my addr 172.21.15.5:0/334901478 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:05.026 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.018+0000 7fc2baffd640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc13eea0 0x7fc2bc0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): get_auth_request con 0x7fc2bc13eea0 auth_method 0 2023-11-01T03:19:05.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:05.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:05.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:05.027 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 1 --2- 172.21.15.5:0/334901478 >> v2:172.21.15.153:3300/0 conn(0x7fc2bc0b3e50 0x7fc2bc0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): get_auth_request con 0x7fc2bc0b3e50 auth_method 0 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:05.028 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:05.029 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:05.029 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:05.029 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.019+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:05.029 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.020+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:05.029 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_done global_id 4270 payload 274 2023-11-01T03:19:05.030 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 1 -- 172.21.15.5:0/334901478 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc13eea0 msgr2=0x7fc2bc0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:05.030 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc13eea0 0x7fc2bc0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.030 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 1 -- 172.21.15.5:0/334901478 >> v1:172.21.15.5:6789/0 conn(0x7fc2bc0b19e0 legacy=0x7fc2bc0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.030 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 10 monclient: _finish_hunting 0 2023-11-01T03:19:05.030 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 1 monclient: found mon.noname-c 2023-11-01T03:19:05.031 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:05.031 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.031 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.021+0000 7fc2ba7fc640 1 -- 172.21.15.5:0/334901478 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc0b0880 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.023+0000 7fc2ba7fc640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b3e50 0x7fc2bc0b0da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ffc2cce49d4083f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/334901478 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac02f050 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: dump: 2023-11-01T03:19:05.035 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:19:05.036 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:05.036 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.036 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.036 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.037 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:05.038 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:05.038 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:05.038 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/334901478 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac031700 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.038 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2c1421640 5 monclient: authenticate success, global_id 4270 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2c1421640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2c1421640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 1 -- 172.21.15.5:0/334901478 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac031a90 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2c1421640 4 set_mon_vals no callback set 2023-11-01T03:19:05.039 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:05.040 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:05.040 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.027+0000 7fc2b9ffb640 10 monclient: dump: 2023-11-01T03:19:05.040 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:19:05.040 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:05.040 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.041 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.041 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:05.041 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.041 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:05.041 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:05.042 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:05.042 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.042 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 10 monclient: shutdown 2023-11-01T03:19:05.042 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:05.042 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 -- 172.21.15.5:0/334901478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b3e50 msgr2=0x7fc2bc0b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b3e50 0x7fc2bc0b0da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02b7a0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 -- 172.21.15.5:0/334901478 shutdown_connections 2023-11-01T03:19:05.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b3e50 0x7fc2bc0b0da0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 --2- 172.21.15.5:0/334901478 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc13eea0 0x7fc2bc0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.043 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 -- 172.21.15.5:0/334901478 >> 172.21.15.5:0/334901478 conn(0x7fc2bc0716e0 msgr2=0x7fc2bc071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 -- 172.21.15.5:0/334901478 shutdown_connections 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 1 -- 172.21.15.5:0/334901478 wait complete. 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.028+0000 7fc2c1421640 10 monclient: build_initial_monmap 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 10 monclient: monmap: 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:epoch 0 2023-11-01T03:19:05.044 INFO:teuthology.misc.health.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:created 0.000000 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:05.045 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:05.046 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:05.046 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.046 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 librados: starting msgr at 2023-11-01T03:19:05.046 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 librados: starting objecter 2023-11-01T03:19:05.046 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 Processor -- start 2023-11-01T03:19:05.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 -- start start 2023-11-01T03:19:05.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 librados: setting wanted keys 2023-11-01T03:19:05.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 1 librados: calling monclient init 2023-11-01T03:19:05.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.029+0000 7fc2c1421640 10 monclient: init 2023-11-01T03:19:05.047 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 0x7fc2bc144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-b con 0x7fc2bc0b19e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc0b3e50 0x7fc2bc13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-c con 0x7fc2bc0b3e50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:05.048 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 0x7fc2bc141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): picked mon.noname-a con 0x7fc2bc13eea0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc141a30 con 0x7fc2bc13eea0 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc141750 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.049 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:05.050 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc135af0 con 0x7fc2bc0b3e50 2023-11-01T03:19:05.050 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:05.050 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2c1421640 10 monclient(hunting): authenticate will time out at 1421.254117s 2023-11-01T03:19:05.050 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2baffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 0x7fc2bc144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.050 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 0x7fc2bc141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.051 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2ba7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc0b3e50 0x7fc2bc13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.051 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 0x7fc2bc141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49622/0 (socket says 172.21.15.5:49622) 2023-11-01T03:19:05.051 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.030+0000 7fc2bb7fe640 1 -- 172.21.15.5:0/2979279090 learned_addr learned my addr 172.21.15.5:0/2979279090 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:05.051 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): get_auth_request con 0x7fc2bc0b19e0 auth_method 0 2023-11-01T03:19:05.051 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): get_auth_request con 0x7fc2bc13eea0 auth_method 0 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:05.052 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:05.053 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): get_auth_request con 0x7fc2bc0b3e50 auth_method 0 2023-11-01T03:19:05.053 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:05.053 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:05.053 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:05.053 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2baffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:05.054 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:05.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:05.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.031+0000 7fc2ba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:05.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 10 monclient(hunting): handle_auth_done global_id 4273 payload 824 2023-11-01T03:19:05.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 -- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc0b3e50 msgr2=0x7fc2bc13f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.055 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc0b3e50 0x7fc2bc13f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 -- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 msgr2=0x7fc2bc141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 0x7fc2bc141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 10 monclient: _finish_hunting 0 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 monclient: found mon.noname-b 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:05.056 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.057 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.034+0000 7fc2baffd640 1 -- 172.21.15.5:0/2979279090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac009400 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.036+0000 7fc2baffd640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 0x7fc2bc144010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e870 tx=0x7fc2b000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:05.058 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.036+0000 7fc2a37fe640 10 client.?.objecter ms_handle_connect 0x7fc2bc0b19e0 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.036+0000 7fc2a37fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000ee60 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: dump: 2023-11-01T03:19:05.059 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:19:05.060 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:05.060 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.060 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.060 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:05.060 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:05.061 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:05.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:05.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000c940 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2c1421640 5 monclient: authenticate success, global_id 4273 2023-11-01T03:19:05.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2c1421640 10 monclient: _renew_subs 2023-11-01T03:19:05.062 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2c1421640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.063 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc135dd0 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.063 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:05.063 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000ccd0 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.063 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:05.063 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2a37fe640 10 monclient: dump: 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:epoch 1 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:05.064 INFO:teuthology.misc.health.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:05.065 INFO:teuthology.misc.health.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:05.065 INFO:teuthology.misc.health.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:05.065 INFO:teuthology.misc.health.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:05.065 INFO:teuthology.misc.health.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:05.065 INFO:teuthology.misc.health.smithi005.stderr: 2023-11-01T03:19:05.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.039+0000 7fc2b97fa640 4 set_mon_vals no callback set 2023-11-01T03:19:05.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.040+0000 7fc2c1421640 10 client.4273.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:05.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.040+0000 7fc2c1421640 10 monclient: _renew_subs 2023-11-01T03:19:05.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.040+0000 7fc2c1421640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.066 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.040+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc141240 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.040+0000 7fc2c1421640 1 librados: init done 2023-11-01T03:19:05.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.041+0000 7fc2c1421640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:05.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.041+0000 7fc2c1421640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:05.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.041+0000 7fc2c1421640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.067 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.041+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc1425e0 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.291+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc2b0013470 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.292+0000 7fc2a37fe640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 0x7fc2a806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:05.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.292+0000 7fc2ba7fc640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 0x7fc2a806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:05.293 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.292+0000 7fc2ba7fc640 10 monclient: get_auth_request con 0x7fc2a806c7f0 auth_method 0 2023-11-01T03:19:05.294 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.292+0000 7fc2ba7fc640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 0x7fc2a806ecb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035000 tx=0x7fc2ac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:05.294 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.292+0000 7fc2a37fe640 10 client.4273.objecter ms_handle_connect 0x7fc2a806c7f0 2023-11-01T03:19:05.295 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.294+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2b000ce30 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.295 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.294+0000 7fc2a37fe640 10 client.4273.objecter ms_dispatch 0x7fc2bc000b90 osd_map(18..18 src has 1..18) v4 2023-11-01T03:19:05.296 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.294+0000 7fc2a37fe640 3 client.4273.objecter handle_osd_map got epochs [18,18] > 0 2023-11-01T03:19:05.296 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.294+0000 7fc2a37fe640 3 client.4273.objecter handle_osd_map decoding full epoch 18 2023-11-01T03:19:05.296 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.294+0000 7fc2a37fe640 20 client.4273.objecter dump_active .. 0 homeless 2023-11-01T03:19:05.304 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.304+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2b0054e40 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.304+0000 7fc2a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:05.305 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.304+0000 7fc2a37fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:05.498 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.497+0000 7fc2c1421640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:05.499 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.497+0000 7fc2c1421640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:05.499 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.497+0000 7fc2c1421640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:05.499 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.497+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2bc060980 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.905 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.904+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2b0055210 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.909 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.908+0000 7fc2a37fe640 1 -- 172.21.15.5:0/2979279090 <== mon.1 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12803 (secure 0 0 0) 0x7fc2b003db60 con 0x7fc2bc0b19e0 2023-11-01T03:19:05.910 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.909+0000 7fc2a37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:05.910 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.909+0000 7fc2a37fe640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:05.910 INFO:teuthology.misc.health.smithi005.stdout: 2023-11-01T03:19:05.911 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":18,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:19:02.693713+0000","last_up_change":"2023-11-01T03:19:01.289052+0000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-01T03:18:57.549549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6803","nonce":1232325411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6805","nonce":1232325411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6809","nonce":1232325411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6807","nonce":1232325411}]},"public_addr":"172.21.15.5:6803/1232325411","cluster_addr":"172.21.15.5:6805/1232325411","heartbeat_back_addr":"172.21.15.5:6809/1232325411","heartbeat_front_addr":"172.21.15.5:6807/1232325411","state":["exists","up"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6827","nonce":1708816016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6829","nonce":1708816016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6833","nonce":1708816016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6831","nonce":1708816016}]},"public_addr":"172.21.15.5:6827/1708816016","cluster_addr":"172.21.15.5:6829/1708816016","heartbeat_back_addr":"172.21.15.5:6833/1708816016","heartbeat_front_addr":"172.21.15.5:6831/1708816016","state":["exists","up"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6819","nonce":4138368784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6821","nonce":4138368784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6825","nonce":4138368784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6823","nonce":4138368784}]},"public_addr":"172.21.15.5:6819/4138368784","cluster_addr":"172.21.15.5:6821/4138368784","heartbeat_back_addr":"172.21.15.5:6825/4138368784","heartbeat_front_addr":"172.21.15.5:6823/4138368784","state":["exists","up"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6811","nonce":3809490384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6813","nonce":3809490384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6817","nonce":3809490384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6815","nonce":3809490384}]},"public_addr":"172.21.15.5:6811/3809490384","cluster_addr":"172.21.15.5:6813/3809490384","heartbeat_back_addr":"172.21.15.5:6817/3809490384","heartbeat_front_addr":"172.21.15.5:6815/3809490384","state":["exists","up"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6825","nonce":439822656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6827","nonce":439822656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6831","nonce":439822656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6829","nonce":439822656}]},"public_addr":"172.21.15.153:6825/439822656","cluster_addr":"172.21.15.153:6827/439822656","heartbeat_back_addr":"172.21.15.153:6831/439822656","heartbeat_front_addr":"172.21.15.153:6829/439822656","state":["exists","up"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6817","nonce":3310991586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6819","nonce":3310991586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6823","nonce":3310991586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6821","nonce":3310991586}]},"public_addr":"172.21.15.153:6817/3310991586","cluster_addr":"172.21.15.153:6819/3310991586","heartbeat_back_addr":"172.21.15.153:6823/3310991586","heartbeat_front_addr":"172.21.15.153:6821/3310991586","state":["exists","up"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6801","nonce":1447491004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6803","nonce":1447491004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6807","nonce":1447491004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6805","nonce":1447491004}]},"public_addr":"172.21.15.153:6801/1447491004","cluster_addr":"172.21.15.153:6803/1447491004","heartbeat_back_addr":"172.21.15.153:6807/1447491004","heartbeat_front_addr":"172.21.15.153:6805/1447491004","state":["exists","up"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6809","nonce":1714004960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6811","nonce":1714004960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6815","nonce":1714004960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6813","nonce":1714004960}]},"public_addr":"172.21.15.153:6809/1714004960","cluster_addr":"172.21.15.153:6811/1714004960","heartbeat_back_addr":"172.21.15.153:6815/1714004960","heartbeat_front_addr":"172.21.15.153:6813/1714004960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.146757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.507617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.834352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:58.104985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.169969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.604695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.024179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.795171+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:19:05.912 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 10 librados: watch_flush enter 2023-11-01T03:19:05.912 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 10 librados: watch_flush exit 2023-11-01T03:19:05.912 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 20 client.4273.objecter shutdown clearing up homeless session... 2023-11-01T03:19:05.913 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 10 client.4273.objecter successfully canceled tick 2023-11-01T03:19:05.913 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 msgr2=0x7fc2a806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.913 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 0x7fc2a806ecb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035000 tx=0x7fc2ac008030 comp rx=0 tx=0).stop 2023-11-01T03:19:05.913 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 10 monclient: shutdown 2023-11-01T03:19:05.914 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:05.914 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 msgr2=0x7fc2bc144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:05.914 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 0x7fc2bc144010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e870 tx=0x7fc2b000ed30 comp rx=0 tx=0).stop 2023-11-01T03:19:05.914 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 shutdown_connections 2023-11-01T03:19:05.914 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc2a806c7f0 0x7fc2a806ecb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.915 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2bc13eea0 0x7fc2bc141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.915 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc2bc0b3e50 0x7fc2bc13f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.915 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 --2- 172.21.15.5:0/2979279090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2bc0b19e0 0x7fc2bc144010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:05.915 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 >> 172.21.15.5:0/2979279090 conn(0x7fc2bc0716e0 msgr2=0x7fc2bc073690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:05.915 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 shutdown_connections 2023-11-01T03:19:05.916 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 -- 172.21.15.5:0/2979279090 wait complete. 2023-11-01T03:19:05.916 INFO:teuthology.misc.health.smithi005.stderr:2023-11-01T03:19:05.911+0000 7fc2c1421640 1 librados: shutdown 2023-11-01T03:19:05.923 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-01T03:19:05.924 INFO:tasks.ceph:Creating RBD pool 2023-11-01T03:19:05.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-01T03:19:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.031+0000 7fb39cbf0640 10 monclient: get_monmap_and_config 2023-11-01T03:19:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.031+0000 7fb39cbf0640 10 monclient: build_initial_monmap 2023-11-01T03:19:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.031+0000 7fb39cbf0640 10 monclient: monmap: 2023-11-01T03:19:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:06.032617+0000 2023-11-01T03:19:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:06.032617+0000 2023-11-01T03:19:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:06.035 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.032+0000 7fb39cbf0640 1 Processor -- start 2023-11-01T03:19:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.032+0000 7fb39cbf0640 1 -- start start 2023-11-01T03:19:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.032+0000 7fb39cbf0640 10 monclient: init 2023-11-01T03:19:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2023-11-01T03:19:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3980b0af0 0x7fb3980ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-c con 0x7fb3980b0af0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0ed0 0x7fb3980ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-b con 0x7fb3980b0ed0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 0x7fb398141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3980adf00 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39813f6b0 con 0x7fb3980adf00 2023-11-01T03:19:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980b3aa0 con 0x7fb3980b0af0 2023-11-01T03:19:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980aee70 con 0x7fb3980b0ed0 2023-11-01T03:19:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39cbf0640 10 monclient(hunting): authenticate will time out at 1422.257126s 2023-11-01T03:19:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb396d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 0x7fb398141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb395d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0ed0 0x7fb3980ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.033+0000 7fb39659c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3980b0af0 0x7fb3980ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 0x7fb398141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49630/0 (socket says 172.21.15.5:49630) 2023-11-01T03:19:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 1 -- 172.21.15.5:0/3705034914 learned_addr learned my addr 172.21.15.5:0/3705034914 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): get_auth_request con 0x7fb3980adf00 auth_method 0 2023-11-01T03:19:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): get_auth_request con 0x7fb3980b0ed0 auth_method 0 2023-11-01T03:19:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): get_auth_request con 0x7fb3980b0af0 auth_method 0 2023-11-01T03:19:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.034+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 10 monclient(hunting): handle_auth_done global_id 4276 payload 274 2023-11-01T03:19:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 -- 172.21.15.5:0/3705034914 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0ed0 msgr2=0x7fb3980ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 --2- 172.21.15.5:0/3705034914 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0ed0 0x7fb3980ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 -- 172.21.15.5:0/3705034914 >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 msgr2=0x7fb398141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 --2- 172.21.15.5:0/3705034914 >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 0x7fb398141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 10 monclient: _finish_hunting 0 2023-11-01T03:19:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 monclient: found mon.noname-c 2023-11-01T03:19:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.036+0000 7fb39659c640 1 -- 172.21.15.5:0/3705034914 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980af390 con 0x7fb3980b0af0 2023-11-01T03:19:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.038+0000 7fb39659c640 1 --2- 172.21.15.5:0/3705034914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980b0af0 0x7fb3980ae7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3980b80a0 tx=0x7fb38802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd3083bf238cd37 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 1 -- 172.21.15.5:0/3705034914 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38802f050 con 0x7fb3980b0af0 2023-11-01T03:19:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: dump: 2023-11-01T03:19:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:06.055 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: _finish_auth 0 2023-11-01T03:19:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 1 -- 172.21.15.5:0/3705034914 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388031700 con 0x7fb3980b0af0 2023-11-01T03:19:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39cbf0640 5 monclient: authenticate success, global_id 4276 2023-11-01T03:19:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39cbf0640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:06.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39cbf0640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39cbf0640 4 set_mon_vals no callback set 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 1 -- 172.21.15.5:0/3705034914 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388031a90 con 0x7fb3980b0af0 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.041+0000 7fb39559a640 10 monclient: dump: 2023-11-01T03:19:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:06.059 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 10 monclient: shutdown 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 -- 172.21.15.5:0/3705034914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980b0af0 msgr2=0x7fb3980ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/3705034914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980b0af0 0x7fb3980ae7e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3980b80a0 tx=0x7fb38802b7a0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 -- 172.21.15.5:0/3705034914 shutdown_connections 2023-11-01T03:19:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/3705034914 >> v2:172.21.15.5:3300/0 conn(0x7fb3980adf00 0x7fb398141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/3705034914 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0ed0 0x7fb3980ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/3705034914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980b0af0 0x7fb3980ae7e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 -- 172.21.15.5:0/3705034914 >> 172.21.15.5:0/3705034914 conn(0x7fb3980b7240 msgr2=0x7fb3980b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 -- 172.21.15.5:0/3705034914 shutdown_connections 2023-11-01T03:19:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.042+0000 7fb39cbf0640 1 -- 172.21.15.5:0/3705034914 wait complete. 2023-11-01T03:19:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.043+0000 7fb39cbf0640 10 monclient: build_initial_monmap 2023-11-01T03:19:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.043+0000 7fb39cbf0640 10 monclient: monmap: 2023-11-01T03:19:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:06.064 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.043+0000 7fb39cbf0640 1 librados: starting msgr at 2023-11-01T03:19:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.043+0000 7fb39cbf0640 1 librados: starting objecter 2023-11-01T03:19:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.043+0000 7fb39cbf0640 1 Processor -- start 2023-11-01T03:19:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 -- start start 2023-11-01T03:19:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 librados: setting wanted keys 2023-11-01T03:19:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 librados: calling monclient init 2023-11-01T03:19:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient: init 2023-11-01T03:19:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:19:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0af0 0x7fb3980a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-c con 0x7fb3980b0af0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 0x7fb3980a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-b con 0x7fb3980a9b00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 0x7fb398144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): picked mon.noname-a con 0x7fb398143ea0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980aac00 con 0x7fb398143ea0 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980a9670 con 0x7fb3980a9b00 2023-11-01T03:19:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980aae30 con 0x7fb3980b0af0 2023-11-01T03:19:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.044+0000 7fb39cbf0640 10 monclient(hunting): authenticate will time out at 1422.268625s 2023-11-01T03:19:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 0x7fb398144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb395d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 0x7fb3980a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb39659c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0af0 0x7fb3980a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 0x7fb398144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49632/0 (socket says 172.21.15.5:49632) 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 1 -- 172.21.15.5:0/1438816746 learned_addr learned my addr 172.21.15.5:0/1438816746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 10 monclient(hunting): get_auth_request con 0x7fb398143ea0 auth_method 0 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb396d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb395d9b640 10 monclient(hunting): get_auth_request con 0x7fb3980a9b00 auth_method 0 2023-11-01T03:19:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb395d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb395d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb39659c640 10 monclient(hunting): get_auth_request con 0x7fb3980b0af0 auth_method 0 2023-11-01T03:19:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb39659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb39659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.045+0000 7fb39659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb396d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.046+0000 7fb39659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 10 monclient(hunting): handle_auth_done global_id 4279 payload 824 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 -- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0af0 msgr2=0x7fb3980a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0af0 0x7fb3980a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 -- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 msgr2=0x7fb398144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 0x7fb398144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 monclient: found mon.noname-b 2023-11-01T03:19:06.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.048+0000 7fb395d9b640 1 -- 172.21.15.5:0/1438816746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009400 con 0x7fb3980a9b00 2023-11-01T03:19:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.051+0000 7fb395d9b640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 0x7fb3980a8d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00e870 tx=0x7fb38c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.051+0000 7fb386ffd640 10 client.?.objecter ms_handle_connect 0x7fb3980a9b00 2023-11-01T03:19:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.051+0000 7fb386ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c00ee60 con 0x7fb3980a9b00 2023-11-01T03:19:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: dump: 2023-11-01T03:19:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:06.080 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb39cbf0640 5 monclient: authenticate success, global_id 4279 2023-11-01T03:19:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c00c940 con 0x7fb3980a9b00 2023-11-01T03:19:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c00ccd0 con 0x7fb3980a9b00 2023-11-01T03:19:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb39cbf0640 10 monclient: _renew_subs 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb39cbf0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3980add50 con 0x7fb3980a9b00 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb394d99640 4 set_mon_vals no callback set 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.054+0000 7fb386ffd640 10 monclient: dump: 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:06.084 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 client.4279.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 monclient: _renew_subs 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3981d9a40 con 0x7fb3980a9b00 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 1 librados: init done 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.055+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3980a9450 con 0x7fb3980a9b00 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.074+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb38c013470 con 0x7fb3980a9b00 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.074+0000 7fb386ffd640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 0x7fb37806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.074+0000 7fb39659c640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 0x7fb37806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.074+0000 7fb39659c640 10 monclient: get_auth_request con 0x7fb37806c850 auth_method 0 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 10 client.4279.objecter ms_handle_connect 0x7fb37806c850 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb39659c640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 0x7fb37806ed10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb388035000 tx=0x7fb388008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb38c00ce30 con 0x7fb3980a9b00 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 10 client.4279.objecter ms_dispatch 0x7fb398000b90 osd_map(18..18 src has 1..18) v4 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 3 client.4279.objecter handle_osd_map got epochs [18,18] > 0 2023-11-01T03:19:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 3 client.4279.objecter handle_osd_map decoding full epoch 18 2023-11-01T03:19:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.075+0000 7fb386ffd640 20 client.4279.objecter dump_active .. 0 homeless 2023-11-01T03:19:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.311+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb38c054e60 con 0x7fb3980a9b00 2023-11-01T03:19:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.311+0000 7fb386ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.311+0000 7fb386ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:06.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.521+0000 7fb39cbf0640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-01T03:19:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.521+0000 7fb39cbf0640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-01T03:19:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.521+0000 7fb39cbf0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:06.521+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb39804e9f0 con 0x7fb3980a9b00 2023-11-01T03:19:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.682+0000 7fb386ffd640 1 -- 172.21.15.5:0/1438816746 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb38c0210a0 con 0x7fb3980a9b00 2023-11-01T03:19:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.682+0000 7fb386ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-01T03:19:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.682+0000 7fb386ffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2023-11-01T03:19:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2023-11-01T03:19:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 10 librados: watch_flush enter 2023-11-01T03:19:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 10 librados: watch_flush exit 2023-11-01T03:19:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 20 client.4279.objecter shutdown clearing up homeless session... 2023-11-01T03:19:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 10 client.4279.objecter successfully canceled tick 2023-11-01T03:19:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 msgr2=0x7fb37806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 0x7fb37806ed10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb388035000 tx=0x7fb388008030 comp rx=0 tx=0).stop 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 10 monclient: shutdown 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 msgr2=0x7fb3980a8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 0x7fb3980a8d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00e870 tx=0x7fb38c00ed30 comp rx=0 tx=0).stop 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 shutdown_connections 2023-11-01T03:19:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb37806c850 0x7fb37806ed10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb398143ea0 0x7fb398144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3980a9b00 0x7fb3980a8d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 --2- 172.21.15.5:0/1438816746 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb3980b0af0 0x7fb3980a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.684+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 >> 172.21.15.5:0/1438816746 conn(0x7fb3980b7240 msgr2=0x7fb3980b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.685+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 shutdown_connections 2023-11-01T03:19:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.685+0000 7fb39cbf0640 1 -- 172.21.15.5:0/1438816746 wait complete. 2023-11-01T03:19:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.685+0000 7fb39cbf0640 1 librados: shutdown 2023-11-01T03:19:07.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-01T03:19:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.805+0000 7f43d54a2640 10 monclient: get_monmap_and_config 2023-11-01T03:19:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.806+0000 7f43d54a2640 10 monclient: build_initial_monmap 2023-11-01T03:19:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.806+0000 7f43d54a2640 10 monclient: monmap: 2023-11-01T03:19:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:07.806946+0000 2023-11-01T03:19:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:07.806946+0000 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:07.810 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.806+0000 7f43d54a2640 1 Processor -- start 2023-11-01T03:19:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.806+0000 7f43d54a2640 1 -- start start 2023-11-01T03:19:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.806+0000 7f43d54a2640 10 monclient: init 2023-11-01T03:19:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2023-11-01T03:19:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43d00b42c0 0x7f43d00a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-c con 0x7f43d00b42c0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f43d00a8770 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-b con 0x7f43d013f300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00a8d00 con 0x7f43d00a8770 2023-11-01T03:19:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b46a0 con 0x7f43d00b42c0 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00ade80 con 0x7f43d013f300 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43d54a2640 10 monclient(hunting): authenticate will time out at 1424.031396s 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.807+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43ceffd640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43d00b42c0 0x7f43d00a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59184/0 (socket says 172.21.15.5:59184) 2023-11-01T03:19:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 1 -- 172.21.15.5:0/857353583 learned_addr learned my addr 172.21.15.5:0/857353583 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): get_auth_request con 0x7f43d013f300 auth_method 0 2023-11-01T03:19:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43ceffd640 10 monclient(hunting): get_auth_request con 0x7f43d00b42c0 auth_method 0 2023-11-01T03:19:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43ceffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43ceffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.808+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.809+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.809+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.809+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_done global_id 4229 payload 274 2023-11-01T03:19:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 1 -- 172.21.15.5:0/857353583 >> v2:172.21.15.153:3300/0 conn(0x7f43d00b42c0 msgr2=0x7f43d00a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/857353583 >> v2:172.21.15.153:3300/0 conn(0x7f43d00b42c0 0x7f43d00a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 1 -- 172.21.15.5:0/857353583 >> v1:172.21.15.153:6789/0 conn(0x7f43d00a8770 legacy=0x7f43d013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 1 monclient: found mon.noname-b 2023-11-01T03:19:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:07.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.810+0000 7f43cf7fe640 1 -- 172.21.15.5:0/857353583 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00adfc0 con 0x7f43d013f300 2023-11-01T03:19:07.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.812+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/857353583 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009e50 tx=0x7f43c802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75293fc3f9ccc51 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 1 -- 172.21.15.5:0/857353583 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c802c9e0 con 0x7f43d013f300 2023-11-01T03:19:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:07.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: dump: 2023-11-01T03:19:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:07.827 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 1 -- 172.21.15.5:0/857353583 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c802cb40 con 0x7f43d013f300 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 5 monclient: authenticate success, global_id 4229 2023-11-01T03:19:07.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 4 set_mon_vals no callback set 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 1 -- 172.21.15.5:0/857353583 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80343f0 con 0x7f43d013f300 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:07.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43cdffb640 10 monclient: dump: 2023-11-01T03:19:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:07.832 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 10 monclient: shutdown 2023-11-01T03:19:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 -- 172.21.15.5:0/857353583 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 msgr2=0x7f43d0144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 --2- 172.21.15.5:0/857353583 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009e50 tx=0x7f43c802be40 comp rx=0 tx=0).stop 2023-11-01T03:19:07.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 -- 172.21.15.5:0/857353583 shutdown_connections 2023-11-01T03:19:07.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 --2- 172.21.15.5:0/857353583 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d013f300 0x7f43d0144f60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 --2- 172.21.15.5:0/857353583 >> v2:172.21.15.153:3300/0 conn(0x7f43d00b42c0 0x7f43d00a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 -- 172.21.15.5:0/857353583 >> 172.21.15.5:0/857353583 conn(0x7f43d0065ee0 msgr2=0x7f43d00662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 -- 172.21.15.5:0/857353583 shutdown_connections 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.816+0000 7f43d54a2640 1 -- 172.21.15.5:0/857353583 wait complete. 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.817+0000 7f43d54a2640 10 monclient: build_initial_monmap 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.817+0000 7f43d54a2640 10 monclient: monmap: 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:07.834 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:07.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.817+0000 7f43d54a2640 1 librados: starting msgr at 2023-11-01T03:19:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.817+0000 7f43d54a2640 1 librados: starting objecter 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 Processor -- start 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 -- start start 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 librados: setting wanted keys 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 librados: calling monclient init 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient: init 2023-11-01T03:19:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:07.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:19:07.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43d00a8770 0x7f43d01d7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-a con 0x7f43d00a8770 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:07.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 0x7f43d00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-c con 0x7f43d00b42c0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 0x7f43d00ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): picked mon.noname-b con 0x7f43d013f300 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00adcf0 con 0x7f43d00a8770 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:07.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b0fb0 con 0x7f43d013f300 2023-11-01T03:19:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01d6e50 con 0x7f43d00b42c0 2023-11-01T03:19:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.818+0000 7f43d54a2640 10 monclient(hunting): authenticate will time out at 1424.042836s 2023-11-01T03:19:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 0x7f43d00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 0x7f43d00ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59196/0 (socket says 172.21.15.5:59196) 2023-11-01T03:19:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 1 -- 172.21.15.5:0/4259966173 learned_addr learned my addr 172.21.15.5:0/4259966173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 10 monclient(hunting): get_auth_request con 0x7f43d00b42c0 auth_method 0 2023-11-01T03:19:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43ce7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.819+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 0x7f43d00ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): get_auth_request con 0x7f43d013f300 auth_method 0 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43ce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43ce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43ce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.820+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.821+0000 7f43ceffd640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43d00a8770 0x7f43d01d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.821+0000 7f43ceffd640 10 monclient(hunting): get_auth_request con 0x7f43d00a8770 auth_method 0 2023-11-01T03:19:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.821+0000 7f43ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.821+0000 7f43ceffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.821+0000 7f43ceffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.822+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.822+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.822+0000 7f43ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2023-11-01T03:19:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 -- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 msgr2=0x7f43d00ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 0x7f43d00ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 -- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43d00a8770 msgr2=0x7f43d01d7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43d00a8770 0x7f43d01d7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 monclient: found mon.noname-b 2023-11-01T03:19:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.823+0000 7f43cf7fe640 1 -- 172.21.15.5:0/4259966173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009b30 con 0x7f43d013f300 2023-11-01T03:19:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.826+0000 7f43cf7fe640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 0x7f43d00ad7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43c8032000 tx=0x7f43c8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.826+0000 7f43b77fe640 10 client.?.objecter ms_handle_connect 0x7f43d013f300 2023-11-01T03:19:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.826+0000 7f43b77fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009510 con 0x7f43d013f300 2023-11-01T03:19:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: dump: 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:07.852 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c803e450 con 0x7f43d013f300 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 5 monclient: authenticate success, global_id 4285 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 10 monclient: _renew_subs 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d00b6060 con 0x7f43d013f300 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43cd7fa640 4 set_mon_vals no callback set 2023-11-01T03:19:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 10 client.4285.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 10 monclient: _renew_subs 2023-11-01T03:19:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c803e820 con 0x7f43d013f300 2023-11-01T03:19:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d01d7a90 con 0x7f43d013f300 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43d54a2640 1 librados: init done 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.832+0000 7f43b77fe640 10 monclient: dump: 2023-11-01T03:19:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:07.857 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.833+0000 7f43d54a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:07.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.833+0000 7f43d54a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:07.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.833+0000 7f43d54a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:07.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.833+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d01d6cb0 con 0x7f43d013f300 2023-11-01T03:19:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.853+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43c803e980 con 0x7f43d013f300 2023-11-01T03:19:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.854+0000 7f43b77fe640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 0x7f43bc06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.854+0000 7f43ceffd640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 0x7f43bc06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.854+0000 7f43ceffd640 10 monclient: get_auth_request con 0x7f43bc06c800 auth_method 0 2023-11-01T03:19:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.854+0000 7f43b77fe640 10 client.4285.objecter ms_handle_connect 0x7f43bc06c800 2023-11-01T03:19:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.854+0000 7f43ceffd640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 0x7f43bc06ecc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009b40 tx=0x7f43c0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.857+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f43c807b260 con 0x7f43d013f300 2023-11-01T03:19:07.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.857+0000 7f43b77fe640 10 client.4285.objecter ms_dispatch 0x7f43d0000b90 osd_map(19..19 src has 1..19) v4 2023-11-01T03:19:07.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.857+0000 7f43b77fe640 3 client.4285.objecter handle_osd_map got epochs [19,19] > 0 2023-11-01T03:19:07.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.857+0000 7f43b77fe640 3 client.4285.objecter handle_osd_map decoding full epoch 19 2023-11-01T03:19:07.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:07.857+0000 7f43b77fe640 20 client.4285.objecter dump_active .. 0 homeless 2023-11-01T03:19:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.114+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43c80775a0 con 0x7f43d013f300 2023-11-01T03:19:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.114+0000 7f43b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.114+0000 7f43b77fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:08.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.337+0000 7f43d54a2640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-01T03:19:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.337+0000 7f43d54a2640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-01T03:19:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.337+0000 7f43d54a2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.337+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43d01d6cb0 con 0x7f43d013f300 2023-11-01T03:19:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.752+0000 7f43b77fe640 1 -- 172.21.15.5:0/4259966173 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f43d01d6cb0 con 0x7f43d013f300 2023-11-01T03:19:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.752+0000 7f43b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-01T03:19:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.752+0000 7f43b77fe640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2023-11-01T03:19:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-01T03:19:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 10 librados: watch_flush enter 2023-11-01T03:19:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 10 librados: watch_flush exit 2023-11-01T03:19:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 20 client.4285.objecter shutdown clearing up homeless session... 2023-11-01T03:19:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 10 client.4285.objecter successfully canceled tick 2023-11-01T03:19:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 msgr2=0x7f43bc06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 0x7f43bc06ecc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009b40 tx=0x7f43c0009190 comp rx=0 tx=0).stop 2023-11-01T03:19:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 10 monclient: shutdown 2023-11-01T03:19:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 msgr2=0x7f43d00ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 0x7f43d00ad7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43c8032000 tx=0x7f43c8004a40 comp rx=0 tx=0).stop 2023-11-01T03:19:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 shutdown_connections 2023-11-01T03:19:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f43bc06c800 0x7f43bc06ecc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43d013f300 0x7f43d00ad7b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f43d00b42c0 0x7f43d00ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 --2- 172.21.15.5:0/4259966173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43d00a8770 0x7f43d01d7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.754+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 >> 172.21.15.5:0/4259966173 conn(0x7f43d0065ee0 msgr2=0x7f43d013a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.755+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 shutdown_connections 2023-11-01T03:19:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.755+0000 7f43d54a2640 1 -- 172.21.15.5:0/4259966173 wait complete. 2023-11-01T03:19:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.755+0000 7f43d54a2640 1 librados: shutdown 2023-11-01T03:19:08.766 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-01T03:19:08.767 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-01T03:19:08.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-01T03:19:08.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-01T03:19:08.768 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-01T03:19:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.878+0000 7fee661a5640 10 monclient: get_monmap_and_config 2023-11-01T03:19:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.878+0000 7fee661a5640 10 monclient: build_initial_monmap 2023-11-01T03:19:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.878+0000 7fee661a5640 10 monclient: monmap: 2023-11-01T03:19:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:08.879704+0000 2023-11-01T03:19:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:08.879704+0000 2023-11-01T03:19:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:08.883 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.879+0000 7fee661a5640 1 Processor -- start 2023-11-01T03:19:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.879+0000 7fee661a5640 1 -- start start 2023-11-01T03:19:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.879+0000 7fee661a5640 10 monclient: init 2023-11-01T03:19:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2023-11-01T03:19:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fee600a8ae0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:08.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee6013f340 0x7fee60145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-a con 0x7fee6013f340 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fee600a8ec0 0x7fee60145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-c con 0x7fee600a8ec0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600a9600 con 0x7fee600a8ae0 2023-11-01T03:19:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:08.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600a9360 con 0x7fee6013f340 2023-11-01T03:19:08.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:08.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600b80b0 con 0x7fee600a8ec0 2023-11-01T03:19:08.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.880+0000 7fee661a5640 10 monclient(hunting): authenticate will time out at 1425.104500s 2023-11-01T03:19:08.888 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:10.194 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:08.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.886+0000 7fee5effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee6013f340 0x7fee60145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.908+0000 7fee5effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee6013f340 0x7fee60145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52004/0 (socket says 172.21.15.5:52004) 2023-11-01T03:19:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.909+0000 7fee5effd640 1 -- 172.21.15.5:0/2230087032 learned_addr learned my addr 172.21.15.5:0/2230087032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.909+0000 7fee5effd640 10 monclient(hunting): get_auth_request con 0x7fee6013f340 auth_method 0 2023-11-01T03:19:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.909+0000 7fee5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.909+0000 7fee5effd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.909+0000 7fee5effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:08.957 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:10.266 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:08.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:08.968+0000 7fee5ffff640 1 --2- 172.21.15.5:0/2230087032 >> v2:172.21.15.153:3300/0 conn(0x7fee600a8ec0 0x7fee60145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:08.979 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:10.289 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:08.986 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:10.257 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5ffff640 10 monclient(hunting): get_auth_request con 0x7fee600a8ec0 auth_method 0 2023-11-01T03:19:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5ffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.008+0000 7fee5ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 10 monclient(hunting): handle_auth_done global_id 4251 payload 274 2023-11-01T03:19:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 1 -- 172.21.15.5:0/2230087032 >> v2:172.21.15.153:3300/0 conn(0x7fee600a8ec0 msgr2=0x7fee60145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 1 --2- 172.21.15.5:0/2230087032 >> v2:172.21.15.153:3300/0 conn(0x7fee600a8ec0 0x7fee60145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 1 -- 172.21.15.5:0/2230087032 >> v1:172.21.15.153:6789/0 conn(0x7fee600a8ae0 legacy=0x7fee6013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 10 monclient: _finish_hunting 0 2023-11-01T03:19:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 1 monclient: found mon.noname-a 2023-11-01T03:19:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.042+0000 7fee5effd640 1 -- 172.21.15.5:0/2230087032 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60145a80 con 0x7fee6013f340 2023-11-01T03:19:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.048+0000 7fee5effd640 1 --2- 172.21.15.5:0/2230087032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6013f340 0x7fee60145000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee600b3c60 tx=0x7fee5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b5146e9bce325f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:09.050 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:10.359 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.054 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:10.325 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 1 -- 172.21.15.5:0/2230087032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54031870 con 0x7fee6013f340 2023-11-01T03:19:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: dump: 2023-11-01T03:19:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 1 -- 172.21.15.5:0/2230087032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540319d0 con 0x7fee6013f340 2023-11-01T03:19:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:09.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 1 -- 172.21.15.5:0/2230087032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54031d60 con 0x7fee6013f340 2023-11-01T03:19:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 5 monclient: authenticate success, global_id 4251 2023-11-01T03:19:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 4 set_mon_vals no callback set 2023-11-01T03:19:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee5e7fc640 10 monclient: dump: 2023-11-01T03:19:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:09.129 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:09.129 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 10 monclient: shutdown 2023-11-01T03:19:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 -- 172.21.15.5:0/2230087032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6013f340 msgr2=0x7fee60145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 --2- 172.21.15.5:0/2230087032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6013f340 0x7fee60145000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fee600b3c60 tx=0x7fee5402b910 comp rx=0 tx=0).stop 2023-11-01T03:19:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 -- 172.21.15.5:0/2230087032 shutdown_connections 2023-11-01T03:19:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 --2- 172.21.15.5:0/2230087032 >> v2:172.21.15.153:3300/0 conn(0x7fee600a8ec0 0x7fee60145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 --2- 172.21.15.5:0/2230087032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6013f340 0x7fee60145000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.121+0000 7fee661a5640 1 -- 172.21.15.5:0/2230087032 >> 172.21.15.5:0/2230087032 conn(0x7fee600b7230 msgr2=0x7fee600b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 1 -- 172.21.15.5:0/2230087032 shutdown_connections 2023-11-01T03:19:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 1 -- 172.21.15.5:0/2230087032 wait complete. 2023-11-01T03:19:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 10 monclient: build_initial_monmap 2023-11-01T03:19:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 10 monclient: monmap: 2023-11-01T03:19:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:09.136 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:09.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 1 librados: starting msgr at 2023-11-01T03:19:09.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.122+0000 7fee661a5640 1 librados: starting objecter 2023-11-01T03:19:09.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.123+0000 7fee661a5640 1 Processor -- start 2023-11-01T03:19:09.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.123+0000 7fee661a5640 1 -- start start 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.123+0000 7fee661a5640 1 librados: setting wanted keys 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.123+0000 7fee661a5640 1 librados: calling monclient init 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.123+0000 7fee661a5640 10 monclient: init 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:19:09.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee600a8ae0 0x7fee60142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-a con 0x7fee600a8ae0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee600a8ec0 0x7fee601436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-b con 0x7fee600a8ec0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): picked mon.noname-c con 0x7fee6013f340 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b6f60 con 0x7fee600a8ae0 2023-11-01T03:19:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee60135950 con 0x7fee600a8ec0 2023-11-01T03:19:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee60143bf0 con 0x7fee6013f340 2023-11-01T03:19:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.124+0000 7fee661a5640 10 monclient(hunting): authenticate will time out at 1425.348183s 2023-11-01T03:19:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee600a8ec0 0x7fee601436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59198/0 (socket says 172.21.15.5:59198) 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 1 -- 172.21.15.5:0/151417810 learned_addr learned my addr 172.21.15.5:0/151417810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 10 monclient(hunting): get_auth_request con 0x7fee6013f340 auth_method 0 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:09.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.129+0000 7fee5ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5effd640 10 monclient(hunting): get_auth_request con 0x7fee600a8ec0 auth_method 0 2023-11-01T03:19:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5effd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.130+0000 7fee5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 10 monclient(hunting): handle_auth_done global_id 4235 payload 824 2023-11-01T03:19:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 -- 172.21.15.5:0/151417810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee600a8ec0 msgr2=0x7fee601436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee600a8ec0 0x7fee601436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 -- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee600a8ae0 msgr2=0x7fee60142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee600a8ae0 0x7fee60142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 monclient: found mon.noname-c 2023-11-01T03:19:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.135+0000 7fee5ffff640 1 -- 172.21.15.5:0/151417810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540094d0 con 0x7fee6013f340 2023-11-01T03:19:09.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.172+0000 7fee5ffff640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee58007e30 tx=0x7fee5800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:09.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.172+0000 7fee47fff640 10 client.?.objecter ms_handle_connect 0x7fee6013f340 2023-11-01T03:19:09.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.172+0000 7fee47fff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58014620 con 0x7fee6013f340 2023-11-01T03:19:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: dump: 2023-11-01T03:19:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:09.220 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: _finish_auth 0 2023-11-01T03:19:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800ee90 con 0x7fee6013f340 2023-11-01T03:19:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580149c0 con 0x7fee6013f340 2023-11-01T03:19:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee661a5640 5 monclient: authenticate success, global_id 4235 2023-11-01T03:19:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee661a5640 10 monclient: _renew_subs 2023-11-01T03:19:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee661a5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee601da0a0 con 0x7fee6013f340 2023-11-01T03:19:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee5dffb640 4 set_mon_vals no callback set 2023-11-01T03:19:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee661a5640 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.215+0000 7fee47fff640 10 monclient: dump: 2023-11-01T03:19:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:09.225 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.216+0000 7fee661a5640 10 monclient: _renew_subs 2023-11-01T03:19:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.216+0000 7fee661a5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.216+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee601da530 con 0x7fee6013f340 2023-11-01T03:19:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.216+0000 7fee661a5640 1 librados: init done 2023-11-01T03:19:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.217+0000 7fee661a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:09.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.217+0000 7fee661a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.217+0000 7fee661a5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.217+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60135e10 con 0x7fee6013f340 2023-11-01T03:19:09.241 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:10.551 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.325 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:10.634 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.325 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:10.596 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:09.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.640+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fee58014b20 con 0x7fee6013f340 2023-11-01T03:19:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.641+0000 7fee47fff640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 0x7fee4c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.641+0000 7fee5f7fe640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 0x7fee4c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:09.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.641+0000 7fee5f7fe640 10 monclient: get_auth_request con 0x7fee4c06c800 auth_method 0 2023-11-01T03:19:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.642+0000 7fee47fff640 10 client.4235.objecter ms_handle_connect 0x7fee4c06c800 2023-11-01T03:19:09.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.642+0000 7fee5f7fe640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 0x7fee4c06ecc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee50007fd0 tx=0x7fee500079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.668+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fee58059f30 con 0x7fee6013f340 2023-11-01T03:19:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.668+0000 7fee47fff640 10 client.4235.objecter ms_dispatch 0x7fee60000b90 osd_map(20..20 src has 1..20) v4 2023-11-01T03:19:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.668+0000 7fee47fff640 3 client.4235.objecter handle_osd_map got epochs [20,20] > 0 2023-11-01T03:19:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.668+0000 7fee47fff640 3 client.4235.objecter handle_osd_map decoding full epoch 20 2023-11-01T03:19:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.668+0000 7fee47fff640 20 client.4235.objecter dump_active .. 0 homeless 2023-11-01T03:19:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.669+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee58055b70 con 0x7fee6013f340 2023-11-01T03:19:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.669+0000 7fee47fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.669+0000 7fee47fff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:09.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.961+0000 7fee661a5640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2023-11-01T03:19:09.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.961+0000 7fee661a5640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2023-11-01T03:19:09.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.961+0000 7fee661a5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:09.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:09.961+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee6004e9f0 con 0x7fee6013f340 2023-11-01T03:19:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.126+0000 7fee47fff640 1 -- 172.21.15.5:0/151417810 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171020 (secure 0 0 0) 0x7fee5801b310 con 0x7fee6013f340 2023-11-01T03:19:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.126+0000 7fee47fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2023-11-01T03:19:10.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.126+0000 7fee47fff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:10.130 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 10 librados: watch_flush enter 2023-11-01T03:19:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 10 librados: watch_flush exit 2023-11-01T03:19:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 20 client.4235.objecter shutdown clearing up homeless session... 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 10 client.4235.objecter successfully canceled tick 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 msgr2=0x7fee4c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 0x7fee4c06ecc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee50007fd0 tx=0x7fee500079a0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 10 monclient: shutdown 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 msgr2=0x7fee601d9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee58007e30 tx=0x7fee5800e4b0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 shutdown_connections 2023-11-01T03:19:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fee4c06c800 0x7fee4c06ecc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fee6013f340 0x7fee601d9b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee600a8ec0 0x7fee601436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 --2- 172.21.15.5:0/151417810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee600a8ae0 0x7fee60142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 >> 172.21.15.5:0/151417810 conn(0x7fee600b7230 msgr2=0x7fee600b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 shutdown_connections 2023-11-01T03:19:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 -- 172.21.15.5:0/151417810 wait complete. 2023-11-01T03:19:10.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.129+0000 7fee661a5640 1 librados: shutdown 2023-11-01T03:19:10.143 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1571677761},{"type":"v1","addr":"172.21.15.5:6801","nonce":1571677761}]},"active_addr":"172.21.15.5:6801/1571677761","active_change":"2023-11-01T03:18:16.967077+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":71180703}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3172789935}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1579488780}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":249235965}]}]} 2023-11-01T03:19:10.149 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-01T03:19:10.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-01T03:19:10.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-01T03:19:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.255+0000 7fea4e0bb640 10 monclient: get_monmap_and_config 2023-11-01T03:19:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.255+0000 7fea4e0bb640 10 monclient: build_initial_monmap 2023-11-01T03:19:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.255+0000 7fea4e0bb640 10 monclient: monmap: 2023-11-01T03:19:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:10.256774+0000 2023-11-01T03:19:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:10.256774+0000 2023-11-01T03:19:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:10.259 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.256+0000 7fea4e0bb640 1 Processor -- start 2023-11-01T03:19:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.256+0000 7fea4e0bb640 1 -- start start 2023-11-01T03:19:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.256+0000 7fea4e0bb640 10 monclient: init 2023-11-01T03:19:10.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:10.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2023-11-01T03:19:10.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fea4806bf20 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:10.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 0x7fea48142430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-b con 0x7fea4806b120 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea4813e810 0x7fea4813eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-c con 0x7fea4813e810 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4806c770 con 0x7fea4806bf20 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea48142970 con 0x7fea4813e810 2023-11-01T03:19:10.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:10.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4806f7e0 con 0x7fea4806b120 2023-11-01T03:19:10.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:10.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea4e0bb640 10 monclient(hunting): authenticate will time out at 1426.481232s 2023-11-01T03:19:10.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea46ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 0x7fea48142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea477fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea4806bf20 0x7fea48141d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56832/0 (socket says 172.21.15.5:56832) 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.257+0000 7fea477fe640 1 -- 172.21.15.5:0/2871368788 learned_addr learned my addr 172.21.15.5:0/2871368788 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): get_auth_request con 0x7fea4806b120 auth_method 0 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:10.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea47fff640 1 --2- 172.21.15.5:0/2871368788 >> v2:172.21.15.153:3300/0 conn(0x7fea4813e810 0x7fea4813eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea47fff640 10 monclient(hunting): get_auth_request con 0x7fea4813e810 auth_method 0 2023-11-01T03:19:10.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:10.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea47fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:10.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea47fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:10.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.258+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.259+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.259+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.259+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 10 monclient(hunting): handle_auth_done global_id 4238 payload 274 2023-11-01T03:19:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea467fc640 1 -- 172.21.15.5:0/2871368788 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813114506 0 0) 0x7fea4806c770 con 0x7fea4806bf20 2023-11-01T03:19:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 1 -- 172.21.15.5:0/2871368788 >> v2:172.21.15.153:3300/0 conn(0x7fea4813e810 msgr2=0x7fea4813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 1 --2- 172.21.15.5:0/2871368788 >> v2:172.21.15.153:3300/0 conn(0x7fea4813e810 0x7fea4813eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 1 -- 172.21.15.5:0/2871368788 >> v1:172.21.15.5:6789/0 conn(0x7fea4806bf20 legacy=0x7fea48141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 10 monclient: _finish_hunting 0 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 1 monclient: found mon.noname-b 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea46ffd640 1 -- 172.21.15.5:0/2871368788 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4806fac0 con 0x7fea4806b120 2023-11-01T03:19:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.261+0000 7fea467fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.263+0000 7fea46ffd640 1 --2- 172.21.15.5:0/2871368788 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 0x7fea48142430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ca1e2fcde2b7b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 1 -- 172.21.15.5:0/2871368788 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c031830 con 0x7fea4806b120 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: dump: 2023-11-01T03:19:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:10.274 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 1 -- 172.21.15.5:0/2871368788 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c031990 con 0x7fea4806b120 2023-11-01T03:19:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 1 -- 172.21.15.5:0/2871368788 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c031d20 con 0x7fea4806b120 2023-11-01T03:19:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea467fc640 10 monclient: dump: 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:10.277 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea4e0bb640 5 monclient: authenticate success, global_id 4238 2023-11-01T03:19:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea4e0bb640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.267+0000 7fea4e0bb640 4 set_mon_vals no callback set 2023-11-01T03:19:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 10 monclient: shutdown 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 -- 172.21.15.5:0/2871368788 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 msgr2=0x7fea48142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/2871368788 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 0x7fea48142430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0097a0 tx=0x7fea3c02b8d0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 -- 172.21.15.5:0/2871368788 shutdown_connections 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/2871368788 >> v2:172.21.15.153:3300/0 conn(0x7fea4813e810 0x7fea4813eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/2871368788 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4806b120 0x7fea48142430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 -- 172.21.15.5:0/2871368788 >> 172.21.15.5:0/2871368788 conn(0x7fea480665e0 msgr2=0x7fea480b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 -- 172.21.15.5:0/2871368788 shutdown_connections 2023-11-01T03:19:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 1 -- 172.21.15.5:0/2871368788 wait complete. 2023-11-01T03:19:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 10 monclient: build_initial_monmap 2023-11-01T03:19:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.268+0000 7fea4e0bb640 10 monclient: monmap: 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:10.282 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 librados: starting msgr at 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 librados: starting objecter 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 Processor -- start 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 -- start start 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 librados: setting wanted keys 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 librados: calling monclient init 2023-11-01T03:19:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient: init 2023-11-01T03:19:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea4806b120 0x7fea480b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-b con 0x7fea4806b120 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea4806bf20 0x7fea481387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-a con 0x7fea4806bf20 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient(hunting): picked mon.noname-c con 0x7fea4813e810 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.269+0000 7fea4e0bb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480ae420 con 0x7fea4806bf20 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48139230 con 0x7fea4806b120 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea480b4790 con 0x7fea4813e810 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea4e0bb640 10 monclient(hunting): authenticate will time out at 1426.493987s 2023-11-01T03:19:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea46ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea4806bf20 0x7fea481387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea477fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea4806b120 0x7fea480b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59216/0 (socket says 172.21.15.5:59216) 2023-11-01T03:19:10.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 1 -- 172.21.15.5:0/3621283236 learned_addr learned my addr 172.21.15.5:0/3621283236 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 10 monclient(hunting): get_auth_request con 0x7fea4813e810 auth_method 0 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea47fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea46ffd640 10 monclient(hunting): get_auth_request con 0x7fea4806bf20 auth_method 0 2023-11-01T03:19:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea46ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea46ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.270+0000 7fea46ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): get_auth_request con 0x7fea4806b120 auth_method 0 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:10.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:10.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea46ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.271+0000 7fea477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 10 monclient(hunting): handle_auth_done global_id 4241 payload 824 2023-11-01T03:19:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 -- 172.21.15.5:0/3621283236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea4806b120 msgr2=0x7fea480b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea4806b120 0x7fea480b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 -- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea4806bf20 msgr2=0x7fea481387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea4806bf20 0x7fea481387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 monclient: found mon.noname-c 2023-11-01T03:19:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.274+0000 7fea47fff640 1 -- 172.21.15.5:0/3621283236 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c009400 con 0x7fea4813e810 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.277+0000 7fea47fff640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea4000efc0 tx=0x7fea4000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.277+0000 7fea2ffff640 10 client.?.objecter ms_handle_connect 0x7fea4813e810 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.277+0000 7fea2ffff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:10.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.280+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40009ba0 con 0x7fea4813e810 2023-11-01T03:19:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: dump: 2023-11-01T03:19:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: _finish_auth 0 2023-11-01T03:19:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000f040 con 0x7fea4813e810 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 5 monclient: authenticate success, global_id 4241 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 10 monclient: _renew_subs 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea480adaf0 con 0x7fea4813e810 2023-11-01T03:19:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400146c0 con 0x7fea4813e810 2023-11-01T03:19:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea2ffff640 10 monclient: dump: 2023-11-01T03:19:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea45ffb640 4 set_mon_vals no callback set 2023-11-01T03:19:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 10 client.4241.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 10 monclient: _renew_subs 2023-11-01T03:19:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea480ae120 con 0x7fea4813e810 2023-11-01T03:19:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.281+0000 7fea4e0bb640 1 librados: init done 2023-11-01T03:19:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.282+0000 7fea4e0bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.282+0000 7fea4e0bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.282+0000 7fea4e0bb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.282+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4804e9f0 con 0x7fea4813e810 2023-11-01T03:19:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.301+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea40014820 con 0x7fea4813e810 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.301+0000 7fea2ffff640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 0x7fea3406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.302+0000 7fea477fe640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 0x7fea3406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.302+0000 7fea477fe640 10 monclient: get_auth_request con 0x7fea3406c850 auth_method 0 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.302+0000 7fea2ffff640 10 client.4241.objecter ms_handle_connect 0x7fea3406c850 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.302+0000 7fea477fe640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 0x7fea3406ed10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea38000f60 tx=0x7fea38007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.304+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fea400595b0 con 0x7fea4813e810 2023-11-01T03:19:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.304+0000 7fea2ffff640 10 client.4241.objecter ms_dispatch 0x7fea48000b90 osd_map(20..20 src has 1..20) v4 2023-11-01T03:19:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.304+0000 7fea2ffff640 3 client.4241.objecter handle_osd_map got epochs [20,20] > 0 2023-11-01T03:19:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.304+0000 7fea2ffff640 3 client.4241.objecter handle_osd_map decoding full epoch 20 2023-11-01T03:19:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.304+0000 7fea2ffff640 20 client.4241.objecter dump_active .. 0 homeless 2023-11-01T03:19:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.565+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea400558f0 con 0x7fea4813e810 2023-11-01T03:19:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.565+0000 7fea2ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.565+0000 7fea2ffff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.768+0000 7fea4e0bb640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.768+0000 7fea4e0bb640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.768+0000 7fea4e0bb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:10.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:10.768+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea480ae5f0 con 0x7fea4813e810 2023-11-01T03:19:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.141+0000 7fea2ffff640 1 -- 172.21.15.5:0/3621283236 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14614 (secure 0 0 0) 0x7fea40018070 con 0x7fea4813e810 2023-11-01T03:19:11.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.141+0000 7fea2ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.141+0000 7fea2ffff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:11.143 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:19:10.009444+0000","last_up_change":"2023-11-01T03:19:01.289052+0000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-01T03:18:57.549549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-01T03:19:06.539615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6803","nonce":1232325411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6805","nonce":1232325411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6809","nonce":1232325411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6807","nonce":1232325411}]},"public_addr":"172.21.15.5:6803/1232325411","cluster_addr":"172.21.15.5:6805/1232325411","heartbeat_back_addr":"172.21.15.5:6809/1232325411","heartbeat_front_addr":"172.21.15.5:6807/1232325411","state":["exists","up"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6827","nonce":1708816016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6829","nonce":1708816016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6833","nonce":1708816016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6831","nonce":1708816016}]},"public_addr":"172.21.15.5:6827/1708816016","cluster_addr":"172.21.15.5:6829/1708816016","heartbeat_back_addr":"172.21.15.5:6833/1708816016","heartbeat_front_addr":"172.21.15.5:6831/1708816016","state":["exists","up"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6819","nonce":4138368784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6821","nonce":4138368784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6825","nonce":4138368784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6823","nonce":4138368784}]},"public_addr":"172.21.15.5:6819/4138368784","cluster_addr":"172.21.15.5:6821/4138368784","heartbeat_back_addr":"172.21.15.5:6825/4138368784","heartbeat_front_addr":"172.21.15.5:6823/4138368784","state":["exists","up"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6811","nonce":3809490384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6813","nonce":3809490384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6817","nonce":3809490384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6815","nonce":3809490384}]},"public_addr":"172.21.15.5:6811/3809490384","cluster_addr":"172.21.15.5:6813/3809490384","heartbeat_back_addr":"172.21.15.5:6817/3809490384","heartbeat_front_addr":"172.21.15.5:6815/3809490384","state":["exists","up"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6825","nonce":439822656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6827","nonce":439822656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6831","nonce":439822656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6829","nonce":439822656}]},"public_addr":"172.21.15.153:6825/439822656","cluster_addr":"172.21.15.153:6827/439822656","heartbeat_back_addr":"172.21.15.153:6831/439822656","heartbeat_front_addr":"172.21.15.153:6829/439822656","state":["exists","up"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6817","nonce":3310991586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6819","nonce":3310991586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6823","nonce":3310991586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6821","nonce":3310991586}]},"public_addr":"172.21.15.153:6817/3310991586","cluster_addr":"172.21.15.153:6819/3310991586","heartbeat_back_addr":"172.21.15.153:6823/3310991586","heartbeat_front_addr":"172.21.15.153:6821/3310991586","state":["exists","up"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6801","nonce":1447491004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6803","nonce":1447491004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6807","nonce":1447491004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6805","nonce":1447491004}]},"public_addr":"172.21.15.153:6801/1447491004","cluster_addr":"172.21.15.153:6803/1447491004","heartbeat_back_addr":"172.21.15.153:6807/1447491004","heartbeat_front_addr":"172.21.15.153:6805/1447491004","state":["exists","up"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6809","nonce":1714004960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6811","nonce":1714004960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6815","nonce":1714004960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6813","nonce":1714004960}]},"public_addr":"172.21.15.153:6809/1714004960","cluster_addr":"172.21.15.153:6811/1714004960","heartbeat_back_addr":"172.21.15.153:6815/1714004960","heartbeat_front_addr":"172.21.15.153:6813/1714004960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.146757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.507617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.834352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:58.104985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.169969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.604695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.024179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.795171+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:19:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 10 librados: watch_flush enter 2023-11-01T03:19:11.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 10 librados: watch_flush exit 2023-11-01T03:19:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 20 client.4241.objecter shutdown clearing up homeless session... 2023-11-01T03:19:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 10 client.4241.objecter successfully canceled tick 2023-11-01T03:19:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 msgr2=0x7fea3406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 0x7fea3406ed10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea38000f60 tx=0x7fea38007d50 comp rx=0 tx=0).stop 2023-11-01T03:19:11.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 10 monclient: shutdown 2023-11-01T03:19:11.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:11.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 msgr2=0x7fea48138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fea4000efc0 tx=0x7fea4000c490 comp rx=0 tx=0).stop 2023-11-01T03:19:11.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 shutdown_connections 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fea3406c850 0x7fea3406ed10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fea4813e810 0x7fea48138cf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea4806bf20 0x7fea481387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 --2- 172.21.15.5:0/3621283236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea4806b120 0x7fea480b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 >> 172.21.15.5:0/3621283236 conn(0x7fea480665e0 msgr2=0x7fea48141260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:11.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 shutdown_connections 2023-11-01T03:19:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 -- 172.21.15.5:0/3621283236 wait complete. 2023-11-01T03:19:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.143+0000 7fea4e0bb640 1 librados: shutdown 2023-11-01T03:19:11.160 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-01T03:19:11.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-01T03:19:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.276+0000 7ff8c427c640 10 monclient: get_monmap_and_config 2023-11-01T03:19:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.276+0000 7ff8c427c640 10 monclient: build_initial_monmap 2023-11-01T03:19:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.276+0000 7ff8c427c640 10 monclient: monmap: 2023-11-01T03:19:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:11.277316+0000 2023-11-01T03:19:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:11.277316+0000 2023-11-01T03:19:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:11.281 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:11.281 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 Processor -- start 2023-11-01T03:19:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 -- start start 2023-11-01T03:19:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient: init 2023-11-01T03:19:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2023-11-01T03:19:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff8bc0b4240 0x7ff8bc0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-c con 0x7ff8bc0b4240 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8bc0b38d0 0x7ff8bc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-a con 0x7ff8bc0b38d0 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff8bc0ade00 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0b0cc0 con 0x7ff8bc0ade00 2023-11-01T03:19:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b4620 con 0x7ff8bc0b38d0 2023-11-01T03:19:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b1690 con 0x7ff8bc0b4240 2023-11-01T03:19:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.277+0000 7ff8c427c640 10 monclient(hunting): authenticate will time out at 1427.501897s 2023-11-01T03:19:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.278+0000 7ff8c2018640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff8bc0b4240 0x7ff8bc0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.278+0000 7ff8c1817640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8bc0b38d0 0x7ff8bc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.278+0000 7ff8c2819640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8bc0ade00 0x7ff8bc13b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56846/0 (socket says 172.21.15.5:56846) 2023-11-01T03:19:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.278+0000 7ff8c2819640 1 -- 172.21.15.5:0/3389703741 learned_addr learned my addr 172.21.15.5:0/3389703741 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): get_auth_request con 0x7ff8bc0b4240 auth_method 0 2023-11-01T03:19:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c1817640 10 monclient(hunting): get_auth_request con 0x7ff8bc0b38d0 auth_method 0 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c1817640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c1817640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c1817640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.279+0000 7ff8c2018640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.280+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.280+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.280+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 10 monclient(hunting): handle_auth_done global_id 4303 payload 274 2023-11-01T03:19:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 1 -- 172.21.15.5:0/3389703741 >> v2:172.21.15.5:3300/0 conn(0x7ff8bc0b38d0 msgr2=0x7ff8bc0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 1 --2- 172.21.15.5:0/3389703741 >> v2:172.21.15.5:3300/0 conn(0x7ff8bc0b38d0 0x7ff8bc0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 1 -- 172.21.15.5:0/3389703741 >> v1:172.21.15.5:6789/0 conn(0x7ff8bc0ade00 legacy=0x7ff8bc13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 10 monclient: _finish_hunting 0 2023-11-01T03:19:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 1 monclient: found mon.noname-c 2023-11-01T03:19:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.281+0000 7ff8c2018640 1 -- 172.21.15.5:0/3389703741 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0aeb80 con 0x7ff8bc0b4240 2023-11-01T03:19:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.284+0000 7ff8c2018640 1 --2- 172.21.15.5:0/3389703741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc0b1150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097a0 tx=0x7ff8b802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8893c14a16a11507 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 1 -- 172.21.15.5:0/3389703741 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b802e070 con 0x7ff8bc0b4240 2023-11-01T03:19:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: dump: 2023-11-01T03:19:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:11.298 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: _finish_auth 0 2023-11-01T03:19:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: _check_auth_tickets 2023-11-01T03:19:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 1 -- 172.21.15.5:0/3389703741 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b80315a0 con 0x7ff8bc0b4240 2023-11-01T03:19:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 1 -- 172.21.15.5:0/3389703741 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8031930 con 0x7ff8bc0b4240 2023-11-01T03:19:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c427c640 5 monclient: authenticate success, global_id 4303 2023-11-01T03:19:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c427c640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c1016640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.287+0000 7ff8c427c640 4 set_mon_vals no callback set 2023-11-01T03:19:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c1016640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c1016640 10 monclient: dump: 2023-11-01T03:19:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:11.301 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:11.303 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 10 monclient: shutdown 2023-11-01T03:19:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 -- 172.21.15.5:0/3389703741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc0b4240 msgr2=0x7ff8bc0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 --2- 172.21.15.5:0/3389703741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc0b1150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80097a0 tx=0x7ff8b802b840 comp rx=0 tx=0).stop 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 -- 172.21.15.5:0/3389703741 shutdown_connections 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 --2- 172.21.15.5:0/3389703741 >> v2:172.21.15.5:3300/0 conn(0x7ff8bc0b38d0 0x7ff8bc0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 --2- 172.21.15.5:0/3389703741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc0b1150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.288+0000 7ff8c427c640 1 -- 172.21.15.5:0/3389703741 >> 172.21.15.5:0/3389703741 conn(0x7ff8bc065cd0 msgr2=0x7ff8bc0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.289+0000 7ff8c427c640 1 -- 172.21.15.5:0/3389703741 shutdown_connections 2023-11-01T03:19:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.289+0000 7ff8c427c640 1 -- 172.21.15.5:0/3389703741 wait complete. 2023-11-01T03:19:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.289+0000 7ff8c427c640 10 monclient: build_initial_monmap 2023-11-01T03:19:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.289+0000 7ff8c427c640 10 monclient: monmap: 2023-11-01T03:19:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 librados: starting msgr at 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 librados: starting objecter 2023-11-01T03:19:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 Processor -- start 2023-11-01T03:19:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 -- start start 2023-11-01T03:19:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 librados: setting wanted keys 2023-11-01T03:19:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 librados: calling monclient init 2023-11-01T03:19:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient: init 2023-11-01T03:19:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:19:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8bc0ade00 0x7ff8bc141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-c con 0x7ff8bc0ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc13dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-a con 0x7ff8bc0b4240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 0x7ff8bc1d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): picked mon.noname-b con 0x7ff8bc1d9a10 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc13e510 con 0x7ff8bc0b4240 2023-11-01T03:19:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc13e1f0 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1da3e0 con 0x7ff8bc0ade00 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.290+0000 7ff8c427c640 10 monclient(hunting): authenticate will time out at 1427.514787s 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc13dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c2819640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 0x7ff8bc1d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc13dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52056/0 (socket says 172.21.15.5:52056) 2023-11-01T03:19:11.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 1 -- 172.21.15.5:0/2166584463 learned_addr learned my addr 172.21.15.5:0/2166584463 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 10 monclient(hunting): get_auth_request con 0x7ff8bc0b4240 auth_method 0 2023-11-01T03:19:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:11.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c1817640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c2819640 10 monclient(hunting): get_auth_request con 0x7ff8bc1d9a10 auth_method 0 2023-11-01T03:19:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c2819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c2819640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.291+0000 7ff8c2819640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c1817640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c2819640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c2819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.292+0000 7ff8c2819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 10 monclient(hunting): handle_auth_done global_id 4306 payload 824 2023-11-01T03:19:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 -- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8bc0ade00 msgr2=0x7ff8bc141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8bc0ade00 0x7ff8bc141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 -- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 msgr2=0x7ff8bc13dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc13dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 10 monclient: _finish_hunting 0 2023-11-01T03:19:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 monclient: found mon.noname-b 2023-11-01T03:19:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.295+0000 7ff8c2819640 1 -- 172.21.15.5:0/2166584463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009400 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.297+0000 7ff8c2819640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 0x7ff8bc1d9ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400caa0 tx=0x7ff8b400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.297+0000 7ff8b2ffd640 10 client.?.objecter ms_handle_connect 0x7ff8bc1d9a10 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.297+0000 7ff8b2ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ac00 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: dump: 2023-11-01T03:19:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:11.322 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400ad60 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4012600 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8b2ffd640 10 monclient: dump: 2023-11-01T03:19:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:11.325 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:11.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 5 monclient: authenticate success, global_id 4306 2023-11-01T03:19:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 10 monclient: _renew_subs 2023-11-01T03:19:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c0815640 4 set_mon_vals no callback set 2023-11-01T03:19:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc142590 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 10 client.4306.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 10 monclient: _renew_subs 2023-11-01T03:19:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc13eb80 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.301+0000 7ff8c427c640 1 librados: init done 2023-11-01T03:19:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.302+0000 7ff8c427c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.302+0000 7ff8c427c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.302+0000 7ff8c427c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.302+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc04e9f0 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.321+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8b4007070 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.321+0000 7ff8b2ffd640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 0x7ff8a006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.321+0000 7ff8c2018640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 0x7ff8a006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.321+0000 7ff8c2018640 10 monclient: get_auth_request con 0x7ff8a006c800 auth_method 0 2023-11-01T03:19:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.322+0000 7ff8b2ffd640 10 client.4306.objecter ms_handle_connect 0x7ff8a006c800 2023-11-01T03:19:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.322+0000 7ff8c2018640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 0x7ff8a006ecc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8036000 tx=0x7ff8b8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.547+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff8b40585a0 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.547+0000 7ff8b2ffd640 10 client.4306.objecter ms_dispatch 0x7ff8bc000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.547+0000 7ff8b2ffd640 3 client.4306.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.547+0000 7ff8b2ffd640 3 client.4306.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.547+0000 7ff8b2ffd640 20 client.4306.objecter dump_active .. 0 homeless 2023-11-01T03:19:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.559+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8b40548e0 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.559+0000 7ff8b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.559+0000 7ff8b2ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.756+0000 7ff8c427c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.756+0000 7ff8c427c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:11.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.756+0000 7ff8c427c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:11.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.756+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8bc13eb80 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.812+0000 7ff8b2ffd640 1 -- 172.21.15.5:0/2166584463 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14614 (secure 0 0 0) 0x7ff8bc13eb80 con 0x7ff8bc1d9a10 2023-11-01T03:19:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.812+0000 7ff8b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:19:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.812+0000 7ff8b2ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:11.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:11.814 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:19:10.009444+0000","last_up_change":"2023-11-01T03:19:01.289052+0000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-01T03:18:57.549549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-01T03:19:06.539615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6803","nonce":1232325411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6805","nonce":1232325411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6809","nonce":1232325411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6807","nonce":1232325411}]},"public_addr":"172.21.15.5:6803/1232325411","cluster_addr":"172.21.15.5:6805/1232325411","heartbeat_back_addr":"172.21.15.5:6809/1232325411","heartbeat_front_addr":"172.21.15.5:6807/1232325411","state":["exists","up"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6827","nonce":1708816016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6829","nonce":1708816016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6833","nonce":1708816016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6831","nonce":1708816016}]},"public_addr":"172.21.15.5:6827/1708816016","cluster_addr":"172.21.15.5:6829/1708816016","heartbeat_back_addr":"172.21.15.5:6833/1708816016","heartbeat_front_addr":"172.21.15.5:6831/1708816016","state":["exists","up"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6819","nonce":4138368784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6821","nonce":4138368784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6825","nonce":4138368784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6823","nonce":4138368784}]},"public_addr":"172.21.15.5:6819/4138368784","cluster_addr":"172.21.15.5:6821/4138368784","heartbeat_back_addr":"172.21.15.5:6825/4138368784","heartbeat_front_addr":"172.21.15.5:6823/4138368784","state":["exists","up"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6811","nonce":3809490384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6813","nonce":3809490384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6817","nonce":3809490384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6815","nonce":3809490384}]},"public_addr":"172.21.15.5:6811/3809490384","cluster_addr":"172.21.15.5:6813/3809490384","heartbeat_back_addr":"172.21.15.5:6817/3809490384","heartbeat_front_addr":"172.21.15.5:6815/3809490384","state":["exists","up"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6825","nonce":439822656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6827","nonce":439822656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6831","nonce":439822656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6829","nonce":439822656}]},"public_addr":"172.21.15.153:6825/439822656","cluster_addr":"172.21.15.153:6827/439822656","heartbeat_back_addr":"172.21.15.153:6831/439822656","heartbeat_front_addr":"172.21.15.153:6829/439822656","state":["exists","up"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6817","nonce":3310991586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6819","nonce":3310991586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6823","nonce":3310991586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6821","nonce":3310991586}]},"public_addr":"172.21.15.153:6817/3310991586","cluster_addr":"172.21.15.153:6819/3310991586","heartbeat_back_addr":"172.21.15.153:6823/3310991586","heartbeat_front_addr":"172.21.15.153:6821/3310991586","state":["exists","up"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6801","nonce":1447491004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6803","nonce":1447491004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6807","nonce":1447491004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6805","nonce":1447491004}]},"public_addr":"172.21.15.153:6801/1447491004","cluster_addr":"172.21.15.153:6803/1447491004","heartbeat_back_addr":"172.21.15.153:6807/1447491004","heartbeat_front_addr":"172.21.15.153:6805/1447491004","state":["exists","up"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6809","nonce":1714004960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6811","nonce":1714004960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6815","nonce":1714004960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6813","nonce":1714004960}]},"public_addr":"172.21.15.153:6809/1714004960","cluster_addr":"172.21.15.153:6811/1714004960","heartbeat_back_addr":"172.21.15.153:6815/1714004960","heartbeat_front_addr":"172.21.15.153:6813/1714004960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.146757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.507617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.834352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:58.104985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.169969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.604695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.024179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.795171+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:19:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 10 librados: watch_flush enter 2023-11-01T03:19:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 10 librados: watch_flush exit 2023-11-01T03:19:11.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 20 client.4306.objecter shutdown clearing up homeless session... 2023-11-01T03:19:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 10 client.4306.objecter successfully canceled tick 2023-11-01T03:19:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 msgr2=0x7ff8a006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 0x7ff8a006ecc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8036000 tx=0x7ff8b8030000 comp rx=0 tx=0).stop 2023-11-01T03:19:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 10 monclient: shutdown 2023-11-01T03:19:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 msgr2=0x7ff8bc1d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 0x7ff8bc1d9ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400caa0 tx=0x7ff8b400cf60 comp rx=0 tx=0).stop 2023-11-01T03:19:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 shutdown_connections 2023-11-01T03:19:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff8a006c800 0x7ff8a006ecc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8bc1d9a10 0x7ff8bc1d9ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8bc0b4240 0x7ff8bc13dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 --2- 172.21.15.5:0/2166584463 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff8bc0ade00 0x7ff8bc141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 >> 172.21.15.5:0/2166584463 conn(0x7ff8bc065cd0 msgr2=0x7ff8bc0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 shutdown_connections 2023-11-01T03:19:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 -- 172.21.15.5:0/2166584463 wait complete. 2023-11-01T03:19:11.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:11.814+0000 7ff8c427c640 1 librados: shutdown 2023-11-01T03:19:11.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-01T03:19:11.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-01T03:19:11.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-01T03:19:11.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-01T03:19:11.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-01T03:19:11.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-01T03:19:11.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-01T03:19:11.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-01T03:19:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.010+0000 7f9ba7383640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.010+0000 7f9ba7383640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.010+0000 7f9ba7383640 10 monclient: monmap: 2023-11-01T03:19:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.011894+0000 2023-11-01T03:19:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.011894+0000 2023-11-01T03:19:12.014 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.016 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f9ba7383640 1 Processor -- start 2023-11-01T03:19:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.011+0000 7fca9493b640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.011+0000 7fca9493b640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.011+0000 7fca9493b640 10 monclient: monmap: 2023-11-01T03:19:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.012108+0000 2023-11-01T03:19:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.012108+0000 2023-11-01T03:19:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.019 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.020 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7fca9493b640 1 Processor -- start 2023-11-01T03:19:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f923b59e640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f923b59e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f923b59e640 10 monclient: monmap: 2023-11-01T03:19:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.013550+0000 2023-11-01T03:19:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.013550+0000 2023-11-01T03:19:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.023 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f9ba7383640 1 -- start start 2023-11-01T03:19:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.012+0000 7f9ba7383640 10 monclient: init 2023-11-01T03:19:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7fca9493b640 1 -- start start 2023-11-01T03:19:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7fca9493b640 10 monclient: init 2023-11-01T03:19:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2023-11-01T03:19:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9b98006bf0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9b9802a980 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b980c3d30 0x7f9b980d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-a con 0x7f9b980c3d30 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b98032f90 con 0x7f9b98006bf0 2023-11-01T03:19:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f2d6a3a0640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7f2d6a3a0640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7f2d6a3a0640 10 monclient: monmap: 2023-11-01T03:19:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.028 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.014946+0000 2023-11-01T03:19:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.014946+0000 2023-11-01T03:19:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.029 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.030 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.030 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2023-11-01T03:19:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fd2affff640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fd2affff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fd2affff640 10 monclient: monmap: 2023-11-01T03:19:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.015250+0000 2023-11-01T03:19:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.015250+0000 2023-11-01T03:19:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.036 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9802cd40 con 0x7f9b9802a980 2023-11-01T03:19:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fca9006d8d0 0x7fca90070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-c con 0x7fca9006d8d0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca9006dcb0 0x7fca901498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-a con 0x7fca9006dcb0 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca90149e00 0x7fca90142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-b con 0x7fca90149e00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca90070760 con 0x7fca9006dcb0 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca90071a40 con 0x7fca9006d8d0 2023-11-01T03:19:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9006f840 con 0x7fca90149e00 2023-11-01T03:19:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7fca9493b640 10 monclient(hunting): authenticate will time out at 1428.238327s 2023-11-01T03:19:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fca9006d8d0 0x7fca90070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b98033880 con 0x7f9b980c3d30 2023-11-01T03:19:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fca9006d8d0 0x7fca90070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40672/0 (socket says 172.21.15.5:40672) 2023-11-01T03:19:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 1 -- 172.21.15.5:0/2900989863 learned_addr learned my addr 172.21.15.5:0/2900989863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 10 monclient(hunting): get_auth_request con 0x7fca9006d8d0 auth_method 0 2023-11-01T03:19:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8ed9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.013+0000 7f9ba7383640 10 monclient(hunting): authenticate will time out at 1428.237764s 2023-11-01T03:19:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7f9ba511f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b98006bf0 0x7f9b98034ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56854/0 (socket says 172.21.15.5:56854) 2023-11-01T03:19:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.014+0000 7f9ba511f640 1 -- 172.21.15.5:0/2546010209 learned_addr learned my addr 172.21.15.5:0/2546010209 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7f923b59e640 1 Processor -- start 2023-11-01T03:19:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fca8f59e640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca90149e00 0x7fca90142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7f923b59e640 1 -- start start 2023-11-01T03:19:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7f923b59e640 10 monclient: init 2023-11-01T03:19:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fd2affff640 1 Processor -- start 2023-11-01T03:19:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fd2affff640 1 -- start start 2023-11-01T03:19:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.015+0000 7fd2affff640 10 monclient: init 2023-11-01T03:19:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2023-11-01T03:19:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2b00b3d80 0x7fd2b0141e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8f59e640 10 monclient(hunting): get_auth_request con 0x7fca90149e00 auth_method 0 2023-11-01T03:19:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8f59e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fca8f59e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f5d0d98e640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f5d0d98e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f5d0d98e640 10 monclient: monmap: 2023-11-01T03:19:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.017400+0000 2023-11-01T03:19:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.017400+0000 2023-11-01T03:19:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.052 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-a con 0x7fd2b00b3d80 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd2b00b4160 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-b con 0x7fd2b0145920 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b0144cf0 con 0x7fd2b00b4160 2023-11-01T03:19:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00b3770 con 0x7fd2b00b3d80 2023-11-01T03:19:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00b38b0 con 0x7fd2b0145920 2023-11-01T03:19:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7fd2affff640 10 monclient(hunting): authenticate will time out at 1428.240556s 2023-11-01T03:19:12.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f2d6a3a0640 1 Processor -- start 2023-11-01T03:19:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2023-11-01T03:19:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-b con 0x7f9234006f50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f923402c570 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92340c9410 0x7f92340c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-c con 0x7f92340c9410 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923402fb00 con 0x7f923402c570 2023-11-01T03:19:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9234007330 con 0x7f92340c9410 2023-11-01T03:19:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 1 -- start start 2023-11-01T03:19:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 10 monclient: init 2023-11-01T03:19:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923402e0a0 con 0x7f9234006f50 2023-11-01T03:19:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.016+0000 7f923b59e640 10 monclient(hunting): authenticate will time out at 1428.240926s 2023-11-01T03:19:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2023-11-01T03:19:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2d5c037520 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f2d6a3a0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2d5c007a10 0x7f2d5c007ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-c con 0x7f2d5c007a10 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-b con 0x7f2d5c0083e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c032c80 con 0x7f2d5c037520 2023-11-01T03:19:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f5d0d98e640 1 Processor -- start 2023-11-01T03:19:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c02ebc0 con 0x7f2d5c007a10 2023-11-01T03:19:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c032f60 con 0x7f2d5c0083e0 2023-11-01T03:19:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f2d6a3a0640 10 monclient(hunting): authenticate will time out at 1428.242028s 2023-11-01T03:19:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_done global_id 4309 payload 274 2023-11-01T03:19:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 -- 172.21.15.5:0/2900989863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca90149e00 msgr2=0x7fca90142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca90149e00 0x7fca90142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 -- 172.21.15.5:0/2900989863 >> v2:172.21.15.5:3300/0 conn(0x7fca9006dcb0 msgr2=0x7fca901498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/2900989863 >> v2:172.21.15.5:3300/0 conn(0x7fca9006dcb0 0x7fca901498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fca8ed9d640 1 -- 172.21.15.5:0/2900989863 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9006fb20 con 0x7fca9006d8d0 2023-11-01T03:19:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f5d0d98e640 1 -- start start 2023-11-01T03:19:12.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.017+0000 7f5d0d98e640 10 monclient: init 2023-11-01T03:19:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fd7cffff640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fd7cffff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7fd7cffff640 10 monclient: monmap: 2023-11-01T03:19:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.019585+0000 2023-11-01T03:19:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.019585+0000 2023-11-01T03:19:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.072 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2023-11-01T03:19:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5d080af920 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d08142d80 0x7f5d081431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-a con 0x7f5d08142d80 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5d08149190 0x7f5d081495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-c con 0x7f5d08149190 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.018+0000 7f5d0d98e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0806fe80 con 0x7f5d080af920 2023-11-01T03:19:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0806eee0 con 0x7f5d08142d80 2023-11-01T03:19:12.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0806fc80 con 0x7f5d08149190 2023-11-01T03:19:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5d0d98e640 10 monclient(hunting): authenticate will time out at 1428.243015s 2023-11-01T03:19:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f9ba5920640 1 --2- 172.21.15.5:0/2546010209 >> v2:172.21.15.5:3300/0 conn(0x7f9b980c3d30 0x7f9b980d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5fc859e640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5fc859e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f5fc859e640 10 monclient: monmap: 2023-11-01T03:19:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.020389+0000 2023-11-01T03:19:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.020389+0000 2023-11-01T03:19:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.079 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7fd7cffff640 1 Processor -- start 2023-11-01T03:19:12.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7fd7cffff640 1 -- start start 2023-11-01T03:19:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7fd7cffff640 10 monclient: init 2023-11-01T03:19:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f9ba5920640 10 monclient(hunting): get_auth_request con 0x7f9b980c3d30 auth_method 0 2023-11-01T03:19:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f9ba5920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f9ba5920640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.019+0000 7f9ba5920640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f5fc859e640 1 Processor -- start 2023-11-01T03:19:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f5fc859e640 1 -- start start 2023-11-01T03:19:12.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738434623 0 0) 0x7f9b9802cd40 con 0x7f9b9802a980 2023-11-01T03:19:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 10 monclient(hunting): _negotiate 2023-11-01T03:19:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 10 monclient(hunting): my global_id is 4312 2023-11-01T03:19:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8c003520 con 0x7f9b9802a980 2023-11-01T03:19:12.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7f5fc859e640 10 monclient: init 2023-11-01T03:19:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2023-11-01T03:19:12.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd7c80070e0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd7c8036530 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd7c8030b10 0x7fd7c80d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-c con 0x7fd7c8030b10 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c80355f0 con 0x7fd7c8036530 2023-11-01T03:19:12.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c8037580 con 0x7fd7c80070e0 2023-11-01T03:19:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c80074c0 con 0x7fd7c8030b10 2023-11-01T03:19:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.020+0000 7fd7cffff640 10 monclient(hunting): authenticate will time out at 1428.244749s 2023-11-01T03:19:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2023-11-01T03:19:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fc013ed40 0x7f5fc00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-a con 0x7f5fc013ed40 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc00b3110 0x7f5fc0144df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-b con 0x7f5fc00b3110 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc0145330 0x7f5fc0141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-c con 0x7f5fc0145330 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00a89f0 con 0x7f5fc013ed40 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00aa2b0 con 0x7f5fc0145330 2023-11-01T03:19:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00a8c10 con 0x7f5fc00b3110 2023-11-01T03:19:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5fc859e640 10 monclient(hunting): authenticate will time out at 1428.245412s 2023-11-01T03:19:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7f5d07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d08142d80 0x7f5d081431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.021+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca9006d8d0 0x7fca90070220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca900b3d10 tx=0x7fca8002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957bcda190057a0f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273853771 0 0) 0x7f9b98032f90 con 0x7f9b98006bf0 2023-11-01T03:19:12.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 10 monclient(hunting): _negotiate 2023-11-01T03:19:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 10 monclient(hunting): my global_id is 4272 2023-11-01T03:19:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.022+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b9802cd40 con 0x7f9b98006bf0 2023-11-01T03:19:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59248/0 (socket says 172.21.15.5:59248) 2023-11-01T03:19:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3855001818 learned_addr learned my addr 172.21.15.5:0/3855001818 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 10 monclient(hunting): get_auth_request con 0x7fd2b0145920 auth_method 0 2023-11-01T03:19:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.023+0000 7fd2af7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 10 monclient(hunting): handle_auth_done global_id 4275 payload 274 2023-11-01T03:19:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 1 -- 172.21.15.5:0/2546010209 >> v1:172.21.15.153:6789/0 conn(0x7f9b9802a980 legacy=0x7f9b98032880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 1 -- 172.21.15.5:0/2546010209 >> v1:172.21.15.5:6789/0 conn(0x7f9b98006bf0 legacy=0x7f9b98034ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f9ba5920640 1 -- 172.21.15.5:0/2546010209 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980c1870 con 0x7f9b980c3d30 2023-11-01T03:19:12.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7f2d69b9f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.024+0000 7fd2aeffd640 1 --2- 172.21.15.5:0/3855001818 >> v2:172.21.15.5:3300/0 conn(0x7fd2b00b3d80 0x7fd2b0141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59260/0 (socket says 172.21.15.5:59260) 2023-11-01T03:19:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 1 -- 172.21.15.5:0/183539988 learned_addr learned my addr 172.21.15.5:0/183539988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 10 monclient(hunting): get_auth_request con 0x7f2d5c0083e0 auth_method 0 2023-11-01T03:19:12.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f923a59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.025+0000 7f2d69b9f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59258/0 (socket says 172.21.15.5:59258) 2023-11-01T03:19:12.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 1 -- 172.21.15.5:0/46761950 learned_addr learned my addr 172.21.15.5:0/46761950 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): get_auth_request con 0x7f9234006f50 auth_method 0 2023-11-01T03:19:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f2d69b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f2d69b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f2d69b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d08142d80 0x7f5d081431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52088/0 (socket says 172.21.15.5:52088) 2023-11-01T03:19:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 1 -- 172.21.15.5:0/2466720015 learned_addr learned my addr 172.21.15.5:0/2466720015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 10 monclient(hunting): get_auth_request con 0x7f5d08142d80 auth_method 0 2023-11-01T03:19:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f5d07fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7fd2aeffd640 10 monclient(hunting): get_auth_request con 0x7fd2b00b3d80 auth_method 0 2023-11-01T03:19:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7fd2aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7fd2aeffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.026+0000 7fd2aeffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.027+0000 7fd7ce7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd7c8036530 0x7fd7c8033600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56870/0 (socket says 172.21.15.5:56870) 2023-11-01T03:19:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.027+0000 7fd7ce7fc640 1 -- 172.21.15.5:0/604838679 learned_addr learned my addr 172.21.15.5:0/604838679 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f9ba5920640 1 --2- 172.21.15.5:0/2546010209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b980d1960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0097a0 tx=0x7f9b9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef2ebe780f06b49 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f5d07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f5d07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f5d07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 10 monclient(hunting): handle_auth_done global_id 4253 payload 274 2023-11-01T03:19:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 1 -- 172.21.15.5:0/183539988 >> v2:172.21.15.153:3300/0 conn(0x7f2d5c007a10 msgr2=0x7f2d5c007ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 1 --2- 172.21.15.5:0/183539988 >> v2:172.21.15.153:3300/0 conn(0x7f2d5c007a10 0x7f2d5c007ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 1 -- 172.21.15.5:0/183539988 >> v1:172.21.15.153:6789/0 conn(0x7f2d5c037520 legacy=0x7f2d5c033f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.028+0000 7f2d69b9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.029+0000 7f2d69b9f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.029+0000 7f2d69b9f640 1 -- 172.21.15.5:0/183539988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c033240 con 0x7f2d5c0083e0 2023-11-01T03:19:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.030+0000 7f923ad9d640 1 --2- 172.21.15.5:0/46761950 >> v2:172.21.15.153:3300/0 conn(0x7f92340c9410 0x7f92340c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f5d0d18d640 1 --2- 172.21.15.5:0/2466720015 >> v2:172.21.15.153:3300/0 conn(0x7f5d08149190 0x7f5d081495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f5d0d18d640 10 monclient(hunting): get_auth_request con 0x7f5d08149190 auth_method 0 2023-11-01T03:19:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f5d0d18d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f5d0d18d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f5d0d18d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f923ad9d640 10 monclient(hunting): get_auth_request con 0x7f92340c9410 auth_method 0 2023-11-01T03:19:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f923ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f923ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.031+0000 7f923ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 10 monclient(hunting): handle_auth_done global_id 4256 payload 274 2023-11-01T03:19:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 1 -- 172.21.15.5:0/46761950 >> v2:172.21.15.153:3300/0 conn(0x7f92340c9410 msgr2=0x7f92340c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 1 --2- 172.21.15.5:0/46761950 >> v2:172.21.15.153:3300/0 conn(0x7f92340c9410 0x7f92340c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 1 -- 172.21.15.5:0/46761950 >> v1:172.21.15.5:6789/0 conn(0x7f923402c570 legacy=0x7f923402e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.032+0000 7f923a59c640 1 -- 172.21.15.5:0/46761950 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923402ecd0 con 0x7f9234006f50 2023-11-01T03:19:12.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.033+0000 7f5d07fff640 10 monclient(hunting): handle_auth_done global_id 4278 payload 274 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.033+0000 7f5d07fff640 1 -- 172.21.15.5:0/2466720015 >> v2:172.21.15.153:3300/0 conn(0x7f5d08149190 msgr2=0x7f5d081495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.033+0000 7f5d07fff640 1 --2- 172.21.15.5:0/2466720015 >> v2:172.21.15.153:3300/0 conn(0x7f5d08149190 0x7f5d081495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.033+0000 7f5d07fff640 1 -- 172.21.15.5:0/2466720015 >> v1:172.21.15.5:6789/0 conn(0x7f5d080af920 legacy=0x7f5d0806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.033+0000 7f5d07fff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7f5d07fff640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7f5d07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7f5d07fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7f5d07fff640 1 -- 172.21.15.5:0/2466720015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0806e9c0 con 0x7f5d08142d80 2023-11-01T03:19:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_done global_id 4250 payload 274 2023-11-01T03:19:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3855001818 >> v2:172.21.15.5:3300/0 conn(0x7fd2b00b3d80 msgr2=0x7fd2b0141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 1 --2- 172.21.15.5:0/3855001818 >> v2:172.21.15.5:3300/0 conn(0x7fd2b00b3d80 0x7fd2b0141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3855001818 >> v1:172.21.15.153:6789/0 conn(0x7fd2b00b4160 legacy=0x7fd2b0145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.034+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3855001818 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b01416f0 con 0x7fd2b0145920 2023-11-01T03:19:12.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.035+0000 7fd7cf7fe640 1 --2- 172.21.15.5:0/604838679 >> v2:172.21.15.153:3300/0 conn(0x7fd7c8030b10 0x7fd7c80d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.035+0000 7fca8dd9b640 1 -- 172.21.15.5:0/2900989863 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031870 con 0x7fca9006d8d0 2023-11-01T03:19:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.035+0000 7fca8dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.035+0000 7fca8dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.035+0000 7fca8dd9b640 10 monclient: dump: 2023-11-01T03:19:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.125 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.126 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.127 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 1 -- 172.21.15.5:0/2900989863 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca800319d0 con 0x7fca9006d8d0 2023-11-01T03:19:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 5 monclient: authenticate success, global_id 4309 2023-11-01T03:19:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 4 set_mon_vals no callback set 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 1 -- 172.21.15.5:0/2900989863 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031d60 con 0x7fca9006d8d0 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca8dd9b640 10 monclient: dump: 2023-11-01T03:19:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.130 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.131 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.131 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.131 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7f2d69b9f640 1 --2- 172.21.15.5:0/183539988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009870 tx=0x7f2d6002b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32c75c973202c008 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 10 monclient: shutdown 2023-11-01T03:19:12.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 -- 172.21.15.5:0/2900989863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca9006d8d0 msgr2=0x7fca90070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca9006d8d0 0x7fca90070220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca900b3d10 tx=0x7fca8002b910 comp rx=0 tx=0).stop 2023-11-01T03:19:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 -- 172.21.15.5:0/2900989863 shutdown_connections 2023-11-01T03:19:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 --2- 172.21.15.5:0/2900989863 >> v2:172.21.15.5:3300/0 conn(0x7fca9006dcb0 0x7fca901498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca90149e00 0x7fca90142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 --2- 172.21.15.5:0/2900989863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca9006d8d0 0x7fca90070220 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 -- 172.21.15.5:0/2900989863 >> 172.21.15.5:0/2900989863 conn(0x7fca900b2ca0 msgr2=0x7fca900b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 -- 172.21.15.5:0/2900989863 shutdown_connections 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.036+0000 7fca9493b640 1 -- 172.21.15.5:0/2900989863 wait complete. 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.037+0000 7fca9493b640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.037+0000 7fca9493b640 10 monclient: monmap: 2023-11-01T03:19:12.134 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.135 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.135 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.135 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.135 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.135 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.136 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.136 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.136 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.136 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.037+0000 7f5fc6b3b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc0145330 0x7f5fc0141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 librados: starting msgr at 2023-11-01T03:19:12.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 librados: starting objecter 2023-11-01T03:19:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 Processor -- start 2023-11-01T03:19:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 -- start start 2023-11-01T03:19:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 librados: setting wanted keys 2023-11-01T03:19:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 1 librados: calling monclient init 2023-11-01T03:19:12.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.038+0000 7fca9493b640 10 monclient: init 2023-11-01T03:19:12.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc0145330 0x7f5fc0141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40720/0 (socket says 172.21.15.5:40720) 2023-11-01T03:19:12.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/1147659043 learned_addr learned my addr 172.21.15.5:0/1147659043 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 10 monclient(hunting): get_auth_request con 0x7f5fc0145330 auth_method 0 2023-11-01T03:19:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7f5fc6b3b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:19:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca9006d8d0 0x7fca901da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fd2af7fe640 1 --2- 172.21.15.5:0/3855001818 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f1391b53f70ec0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-c con 0x7fca9006d8d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca9006dcb0 0x7fca900af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-a con 0x7fca9006dcb0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 0x7fca900af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): picked mon.noname-b con 0x7fca900b02b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900a9bf0 con 0x7fca9006dcb0 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901db170 con 0x7fca900b02b0 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900afaf0 con 0x7fca9006d8d0 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.039+0000 7fca9493b640 10 monclient(hunting): authenticate will time out at 1428.263879s 2023-11-01T03:19:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.040+0000 7fd7cf7fe640 10 monclient(hunting): get_auth_request con 0x7fd7c8030b10 auth_method 0 2023-11-01T03:19:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.040+0000 7fd7cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.040+0000 7fd7cf7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.040+0000 7fd7cf7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c02e070 con 0x7f9b980c3d30 2023-11-01T03:19:12.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: dump: 2023-11-01T03:19:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 5 monclient: authenticate success, global_id 4275 2023-11-01T03:19:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0315a0 con 0x7f9b980c3d30 2023-11-01T03:19:12.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f923a59c640 1 --2- 172.21.15.5:0/46761950 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16234740f3a93426 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7fd7cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7fd7cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7fd7cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 4 set_mon_vals no callback set 2023-11-01T03:19:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 1 -- 172.21.15.5:0/2546010209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c031930 con 0x7f9b980c3d30 2023-11-01T03:19:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9b97fff640 10 monclient: dump: 2023-11-01T03:19:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.158 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 10 monclient: shutdown 2023-11-01T03:19:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 1 -- 172.21.15.5:0/2546010209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 msgr2=0x7f9b980d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.041+0000 7f9ba7383640 1 --2- 172.21.15.5:0/2546010209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b980d1960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0097a0 tx=0x7f9b9c02b840 comp rx=0 tx=0).stop 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 1 -- 172.21.15.5:0/2546010209 shutdown_connections 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 1 --2- 172.21.15.5:0/2546010209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b980d1960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 1 -- 172.21.15.5:0/2546010209 >> 172.21.15.5:0/2546010209 conn(0x7f9b980060d0 msgr2=0x7f9b980064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 1 -- 172.21.15.5:0/2546010209 shutdown_connections 2023-11-01T03:19:12.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 1 -- 172.21.15.5:0/2546010209 wait complete. 2023-11-01T03:19:12.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f5fc633a640 1 --2- 172.21.15.5:0/1147659043 >> v2:172.21.15.5:3300/0 conn(0x7f5fc013ed40 0x7f5fc00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.042+0000 7f9ba7383640 10 monclient: monmap: 2023-11-01T03:19:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.163 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 librados: starting msgr at 2023-11-01T03:19:12.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 librados: starting objecter 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 Processor -- start 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 -- start start 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 librados: setting wanted keys 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 librados: calling monclient init 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient: init 2023-11-01T03:19:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b98006bf0 0x7f9b980c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-b con 0x7f9b98006bf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b9802a980 0x7f9b980b9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-c con 0x7f9b9802a980 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b9815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): picked mon.noname-a con 0x7f9b980c3d30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980cac30 con 0x7f9b980c3d30 2023-11-01T03:19:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9815ca50 con 0x7f9b98006bf0 2023-11-01T03:19:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980c2cd0 con 0x7f9b9802a980 2023-11-01T03:19:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.043+0000 7f9ba7383640 10 monclient(hunting): authenticate will time out at 1428.267749s 2023-11-01T03:19:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_done global_id 4321 payload 274 2023-11-01T03:19:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/1147659043 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc00b3110 msgr2=0x7f5fc0144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/1147659043 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc00b3110 0x7f5fc0144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/1147659043 >> v2:172.21.15.5:3300/0 conn(0x7f5fc013ed40 msgr2=0x7f5fc00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/1147659043 >> v2:172.21.15.5:3300/0 conn(0x7f5fc013ed40 0x7f5fc00a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.044+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/1147659043 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00b11d0 con 0x7f5fc0145330 2023-11-01T03:19:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 1 -- 172.21.15.5:0/183539988 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60031750 con 0x7f2d5c0083e0 2023-11-01T03:19:12.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: dump: 2023-11-01T03:19:12.171 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.171 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.171 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.172 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.173 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 1 -- 172.21.15.5:0/183539988 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d600318b0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 1 -- 172.21.15.5:0/183539988 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60031c40 con 0x7f2d5c0083e0 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d5bfff640 10 monclient: dump: 2023-11-01T03:19:12.174 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.175 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d6a3a0640 5 monclient: authenticate success, global_id 4253 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d6a3a0640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7f2d6a3a0640 4 set_mon_vals no callback set 2023-11-01T03:19:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 1 -- 172.21.15.5:0/3855001818 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00317c0 con 0x7fd2b0145920 2023-11-01T03:19:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 10 monclient: dump: 2023-11-01T03:19:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2affff640 5 monclient: authenticate success, global_id 4250 2023-11-01T03:19:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd2affff640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 10 monclient(hunting): handle_auth_done global_id 4324 payload 274 2023-11-01T03:19:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/604838679 >> v1:172.21.15.153:6789/0 conn(0x7fd7c80070e0 legacy=0x7fd7c8035e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/604838679 >> v1:172.21.15.5:6789/0 conn(0x7fd7c8036530 legacy=0x7fd7c8033600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.046+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/604838679 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8035890 con 0x7fd7c8030b10 2023-11-01T03:19:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 10 monclient: shutdown 2023-11-01T03:19:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/183539988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 msgr2=0x7f2d5c0d6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 --2- 172.21.15.5:0/183539988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009870 tx=0x7f2d6002b7f0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/183539988 shutdown_connections 2023-11-01T03:19:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 --2- 172.21.15.5:0/183539988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c0083e0 0x7f2d5c0d6fa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 --2- 172.21.15.5:0/183539988 >> v2:172.21.15.153:3300/0 conn(0x7f2d5c007a10 0x7f2d5c007ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/183539988 >> 172.21.15.5:0/183539988 conn(0x7f2d5c006f70 msgr2=0x7f2d5c035b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/183539988 shutdown_connections 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.047+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/183539988 wait complete. 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 10 monclient: monmap: 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 librados: starting msgr at 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 librados: starting objecter 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 Processor -- start 2023-11-01T03:19:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 -- start start 2023-11-01T03:19:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 librados: setting wanted keys 2023-11-01T03:19:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 1 librados: calling monclient init 2023-11-01T03:19:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.048+0000 7f2d6a3a0640 10 monclient: init 2023-11-01T03:19:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c007a10 0x7f2d5c02c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-c con 0x7f2d5c007a10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 0x7f2d5c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-b con 0x7f2d5c0083e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c037520 0x7f2d5c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): picked mon.noname-a con 0x7f2d5c037520 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c02cf20 con 0x7f2d5c037520 2023-11-01T03:19:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c02e390 con 0x7f2d5c0083e0 2023-11-01T03:19:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c02b3f0 con 0x7f2d5c007a10 2023-11-01T03:19:12.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.049+0000 7f2d6a3a0640 10 monclient(hunting): authenticate will time out at 1428.273470s 2023-11-01T03:19:12.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.051+0000 7f5d07fff640 1 --2- 172.21.15.5:0/2466720015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d081431e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d081437e0 tx=0x7f5cfc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c6e54c7ad52c2d server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.052+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 0x7fca900af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.053+0000 7f2d68b9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 0x7f2d5c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 0x7fca900af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40724/0 (socket says 172.21.15.5:40724) 2023-11-01T03:19:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 1 -- 172.21.15.5:0/3828019467 learned_addr learned my addr 172.21.15.5:0/3828019467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 10 monclient(hunting): get_auth_request con 0x7fca900b02b0 auth_method 0 2023-11-01T03:19:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fca8f59e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/1147659043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc0145330 0x7f5fc0141690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00b4a20 tx=0x7f5fb802c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41634827b4a05b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 1 -- 172.21.15.5:0/3855001818 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0031920 con 0x7fd2b0145920 2023-11-01T03:19:12.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 1 -- 172.21.15.5:0/3855001818 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0031cb0 con 0x7fd2b0145920 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2adffb640 10 monclient: dump: 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.197 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.198 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.199 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2affff640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.054+0000 7fd2affff640 4 set_mon_vals no callback set 2023-11-01T03:19:12.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 0x7f2d5c153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40738/0 (socket says 172.21.15.5:40738) 2023-11-01T03:19:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 1 -- 172.21.15.5:0/2699820507 learned_addr learned my addr 172.21.15.5:0/2699820507 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 10 monclient(hunting): get_auth_request con 0x7f2d5c0083e0 auth_method 0 2023-11-01T03:19:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d68b9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca9006d8d0 0x7fca901da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fca8f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 10 monclient: shutdown 2023-11-01T03:19:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 -- 172.21.15.5:0/3855001818 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 msgr2=0x7fd2b014bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 --2- 172.21.15.5:0/3855001818 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a002b860 comp rx=0 tx=0).stop 2023-11-01T03:19:12.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7f2d6939e640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c007a10 0x7f2d5c02c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 -- 172.21.15.5:0/3855001818 shutdown_connections 2023-11-01T03:19:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 --2- 172.21.15.5:0/3855001818 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b0145920 0x7fd2b014bfe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 --2- 172.21.15.5:0/3855001818 >> v2:172.21.15.5:3300/0 conn(0x7fd2b00b3d80 0x7fd2b0141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 -- 172.21.15.5:0/3855001818 >> 172.21.15.5:0/3855001818 conn(0x7fd2b0065cd0 msgr2=0x7fd2b00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 -- 172.21.15.5:0/3855001818 shutdown_connections 2023-11-01T03:19:12.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.055+0000 7fd2affff640 1 -- 172.21.15.5:0/3855001818 wait complete. 2023-11-01T03:19:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d68b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d68b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d68b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): get_auth_request con 0x7f2d5c007a10 auth_method 0 2023-11-01T03:19:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fd2affff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fd2affff640 10 monclient: monmap: 2023-11-01T03:19:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.210 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fd2affff640 1 librados: starting msgr at 2023-11-01T03:19:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fd2affff640 1 librados: starting objecter 2023-11-01T03:19:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7f2d6939e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fca8ed9d640 10 monclient(hunting): get_auth_request con 0x7fca9006d8d0 auth_method 0 2023-11-01T03:19:12.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fca8ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fca8ed9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fca8ed9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.056+0000 7fd2affff640 1 Processor -- start 2023-11-01T03:19:12.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 -- start start 2023-11-01T03:19:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 librados: setting wanted keys 2023-11-01T03:19:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 librados: calling monclient init 2023-11-01T03:19:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient: init 2023-11-01T03:19:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:19:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b00b3d80 0x7fd2b0143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-c con 0x7fd2b00b3d80 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b0145920 0x7fd2b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-b con 0x7fd2b0145920 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 0x7fd2b006f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): picked mon.noname-a con 0x7fd2b013aa30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0070d70 con 0x7fd2b013aa30 2023-11-01T03:19:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b006f1b0 con 0x7fd2b0145920 2023-11-01T03:19:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01445f0 con 0x7fd2b00b3d80 2023-11-01T03:19:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.057+0000 7fd2affff640 10 monclient(hunting): authenticate will time out at 1428.281695s 2023-11-01T03:19:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7fca8ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 1 -- 172.21.15.5:0/46761950 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923002f050 con 0x7f9234006f50 2023-11-01T03:19:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: dump: 2023-11-01T03:19:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.221 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.221 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.221 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.221 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.221 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.222 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 1 -- 172.21.15.5:0/46761950 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230031700 con 0x7f9234006f50 2023-11-01T03:19:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923b59e640 5 monclient: authenticate success, global_id 4256 2023-11-01T03:19:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923b59e640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923b59e640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923b59e640 4 set_mon_vals no callback set 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 1 -- 172.21.15.5:0/46761950 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230031a90 con 0x7f9234006f50 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7f923959a640 10 monclient: dump: 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7fca8f59e640 10 monclient(hunting): handle_auth_done global_id 4327 payload 824 2023-11-01T03:19:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.058+0000 7fca8f59e640 1 -- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca9006d8d0 msgr2=0x7fca901da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fca9006d8d0 0x7fca901da6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 1 -- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca9006dcb0 msgr2=0x7fca900af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca9006dcb0 0x7fca900af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 10 monclient: shutdown 2023-11-01T03:19:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 -- 172.21.15.5:0/46761950 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 msgr2=0x7f92340cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 --2- 172.21.15.5:0/46761950 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f923002b7a0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f9ba511f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b98006bf0 0x7f9b980c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7fca8f59e640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800094d0 con 0x7fca900b02b0 2023-11-01T03:19:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 -- 172.21.15.5:0/46761950 shutdown_connections 2023-11-01T03:19:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 --2- 172.21.15.5:0/46761950 >> v2:172.21.15.153:3300/0 conn(0x7f92340c9410 0x7f92340c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 --2- 172.21.15.5:0/46761950 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9234006f50 0x7f92340cf5e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 -- 172.21.15.5:0/46761950 >> 172.21.15.5:0/46761950 conn(0x7f9234005da0 msgr2=0x7f92340061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 -- 172.21.15.5:0/46761950 shutdown_connections 2023-11-01T03:19:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.059+0000 7f923b59e640 1 -- 172.21.15.5:0/46761950 wait complete. 2023-11-01T03:19:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 1 -- 172.21.15.5:0/2466720015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0317e0 con 0x7f5d08142d80 2023-11-01T03:19:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: dump: 2023-11-01T03:19:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 1 -- 172.21.15.5:0/2466720015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc031940 con 0x7f5d08142d80 2023-11-01T03:19:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 1 -- 172.21.15.5:0/2466720015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc031cd0 con 0x7f5d08142d80 2023-11-01T03:19:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d077fe640 10 monclient: dump: 2023-11-01T03:19:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.239 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d0d98e640 5 monclient: authenticate success, global_id 4278 2023-11-01T03:19:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d0d98e640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f5d0d98e640 4 set_mon_vals no callback set 2023-11-01T03:19:12.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba5920640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b9815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b98006bf0 0x7f9b980c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40730/0 (socket says 172.21.15.5:40730) 2023-11-01T03:19:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 1 -- 172.21.15.5:0/2086560271 learned_addr learned my addr 172.21.15.5:0/2086560271 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 10 monclient(hunting): get_auth_request con 0x7f9b98006bf0 auth_method 0 2023-11-01T03:19:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba511f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba5920640 10 monclient(hunting): get_auth_request con 0x7f9b980c3d30 auth_method 0 2023-11-01T03:19:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba5920640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba5920640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f9ba5920640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f923b59e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.060+0000 7f923b59e640 10 monclient: monmap: 2023-11-01T03:19:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.246 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.247 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 librados: starting msgr at 2023-11-01T03:19:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 librados: starting objecter 2023-11-01T03:19:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 10 monclient: shutdown 2023-11-01T03:19:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 -- 172.21.15.5:0/2466720015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 msgr2=0x7f5d081431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/2466720015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d081431e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d081437e0 tx=0x7f5cfc02b880 comp rx=0 tx=0).stop 2023-11-01T03:19:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 Processor -- start 2023-11-01T03:19:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 -- 172.21.15.5:0/2466720015 shutdown_connections 2023-11-01T03:19:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/2466720015 >> v2:172.21.15.153:3300/0 conn(0x7f5d08149190 0x7f5d081495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/2466720015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d081431e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 -- 172.21.15.5:0/2466720015 >> 172.21.15.5:0/2466720015 conn(0x7f5d0806aee0 msgr2=0x7f5d0806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 -- start start 2023-11-01T03:19:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 librados: setting wanted keys 2023-11-01T03:19:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 1 librados: calling monclient init 2023-11-01T03:19:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 10 monclient: init 2023-11-01T03:19:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 -- 172.21.15.5:0/2466720015 shutdown_connections 2023-11-01T03:19:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f5d0d98e640 1 -- 172.21.15.5:0/2466720015 wait complete. 2023-11-01T03:19:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f9ba5920640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.061+0000 7f923b59e640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:19:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 0x7f9234037e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-a con 0x7f9234006f50 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f923402c570 0x7f92340b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-c con 0x7f923402c570 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340c9410 0x7f92340ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): picked mon.noname-b con 0x7f92340c9410 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c2670 con 0x7f9234006f50 2023-11-01T03:19:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234038550 con 0x7f92340c9410 2023-11-01T03:19:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9234038a70 con 0x7f923402c570 2023-11-01T03:19:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f923b59e640 10 monclient(hunting): authenticate will time out at 1428.286145s 2023-11-01T03:19:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f5d0d98e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7f5d0d98e640 10 monclient: monmap: 2023-11-01T03:19:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.062+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 0x7fd2b006f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 10 monclient(hunting): handle_auth_done global_id 4330 payload 824 2023-11-01T03:19:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 -- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c007a10 msgr2=0x7f2d5c02c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2d5c007a10 0x7f2d5c02c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 -- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c037520 msgr2=0x7f2d5c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c037520 0x7f2d5c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f2d68b9d640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d600094d0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 librados: starting msgr at 2023-11-01T03:19:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 librados: starting objecter 2023-11-01T03:19:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 Processor -- start 2023-11-01T03:19:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f9ba491e640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b9802a980 0x7f9b980b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 -- start start 2023-11-01T03:19:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 librados: setting wanted keys 2023-11-01T03:19:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 1 librados: calling monclient init 2023-11-01T03:19:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f5d0d98e640 10 monclient: init 2023-11-01T03:19:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f9ba491e640 10 monclient(hunting): get_auth_request con 0x7f9b9802a980 auth_method 0 2023-11-01T03:19:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f9ba491e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f9ba491e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.063+0000 7f9ba491e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d080af920 0x7f5d081da990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-b con 0x7f5d080af920 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d08146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-a con 0x7f5d08142d80 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 0x7f5d08146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): picked mon.noname-c con 0x7f5d08149190 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08146b80 con 0x7f5d08142d80 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08148e30 con 0x7f5d080af920 2023-11-01T03:19:12.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081db480 con 0x7f5d08149190 2023-11-01T03:19:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.064+0000 7f5d0d98e640 10 monclient(hunting): authenticate will time out at 1428.288335s 2023-11-01T03:19:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.065+0000 7f9ba491e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.065+0000 7f9ba491e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.065+0000 7f9ba491e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 -- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b9802a980 msgr2=0x7f9b980b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f9b9802a980 0x7f9b980b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 -- 172.21.15.5:0/2086560271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b98006bf0 msgr2=0x7f9b980c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b98006bf0 0x7f9b980c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7f9ba5920640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c009400 con 0x7f9b980c3d30 2023-11-01T03:19:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7fca8f59e640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 0x7fca900af5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ebe0 tx=0x7fca8800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7fca777fe640 10 client.?.objecter ms_handle_connect 0x7fca900b02b0 2023-11-01T03:19:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.066+0000 7fca777fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 0x7fd2b006f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52124/0 (socket says 172.21.15.5:52124) 2023-11-01T03:19:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3190114616 learned_addr learned my addr 172.21.15.5:0/3190114616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 10 monclient(hunting): get_auth_request con 0x7fd2b013aa30 auth_method 0 2023-11-01T03:19:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7fd2af7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 1 -- 172.21.15.5:0/1147659043 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb802ce20 con 0x7f5fc0145330 2023-11-01T03:19:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: dump: 2023-11-01T03:19:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 1 -- 172.21.15.5:0/1147659043 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8034440 con 0x7f5fc0145330 2023-11-01T03:19:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 1 -- 172.21.15.5:0/1147659043 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80347d0 con 0x7f5fc0145330 2023-11-01T03:19:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc859e640 5 monclient: authenticate success, global_id 4321 2023-11-01T03:19:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc859e640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc859e640 4 set_mon_vals no callback set 2023-11-01T03:19:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.069+0000 7f5fc5338640 10 monclient: dump: 2023-11-01T03:19:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.282 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.283 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f9ba5920640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b9815cf00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b98007760 tx=0x7f9b9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f9b95ffb640 10 client.?.objecter ms_handle_connect 0x7f9b980c3d30 2023-11-01T03:19:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f9b95ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 10 monclient: shutdown 2023-11-01T03:19:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 -- 172.21.15.5:0/1147659043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc0145330 msgr2=0x7f5fc0141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 --2- 172.21.15.5:0/1147659043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc0145330 0x7f5fc0141690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00b4a20 tx=0x7f5fb802c070 comp rx=0 tx=0).stop 2023-11-01T03:19:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 -- 172.21.15.5:0/1147659043 shutdown_connections 2023-11-01T03:19:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 --2- 172.21.15.5:0/1147659043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc0145330 0x7f5fc0141690 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 --2- 172.21.15.5:0/1147659043 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc00b3110 0x7f5fc0144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 --2- 172.21.15.5:0/1147659043 >> v2:172.21.15.5:3300/0 conn(0x7f5fc013ed40 0x7f5fc00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 -- 172.21.15.5:0/1147659043 >> 172.21.15.5:0/1147659043 conn(0x7f5fc00b6f00 msgr2=0x7f5fc00b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 -- 172.21.15.5:0/1147659043 shutdown_connections 2023-11-01T03:19:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.070+0000 7f5fc859e640 1 -- 172.21.15.5:0/1147659043 wait complete. 2023-11-01T03:19:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7fd2aeffd640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b00b3d80 0x7fd2b0143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7f5fc859e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.071+0000 7f5fc859e640 10 monclient: monmap: 2023-11-01T03:19:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f2d68b9d640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 0x7f2d5c153780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d64073590 tx=0x7f2d64067250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f2d59ffb640 10 client.?.objecter ms_handle_connect 0x7f2d5c0083e0 2023-11-01T03:19:12.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f2d59ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 librados: starting msgr at 2023-11-01T03:19:12.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 librados: starting objecter 2023-11-01T03:19:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 Processor -- start 2023-11-01T03:19:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 -- start start 2023-11-01T03:19:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 librados: setting wanted keys 2023-11-01T03:19:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 1 librados: calling monclient init 2023-11-01T03:19:12.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7f5fc859e640 10 monclient: init 2023-11-01T03:19:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7fd2aeffd640 10 monclient(hunting): get_auth_request con 0x7fd2b00b3d80 auth_method 0 2023-11-01T03:19:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7fd2aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7fd2aeffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.072+0000 7fd2aeffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc00b3110 0x7f5fc00ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-b con 0x7f5fc00b3110 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc013ed40 0x7f5fc01417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-a con 0x7f5fc013ed40 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 0x7f5fc013a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): picked mon.noname-c con 0x7f5fc0145330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc01420c0 con 0x7f5fc013ed40 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0141cf0 con 0x7f5fc00b3110 2023-11-01T03:19:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0141eb0 con 0x7f5fc0145330 2023-11-01T03:19:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7f5fc859e640 10 monclient(hunting): authenticate will time out at 1428.297695s 2023-11-01T03:19:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7fd2aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7fd2aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.073+0000 7fd2aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.074+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88009a70 con 0x7fca900b02b0 2023-11-01T03:19:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.074+0000 7fca777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.074+0000 7fca777fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.074+0000 7fca777fe640 10 monclient: dump: 2023-11-01T03:19:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.303 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.303 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.303 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800f040 con 0x7fca900b02b0 2023-11-01T03:19:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88014480 con 0x7fca900b02b0 2023-11-01T03:19:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca777fe640 10 monclient: dump: 2023-11-01T03:19:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.308 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.308 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.308 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.309 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.309 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.309 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.309 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca8d59a640 4 set_mon_vals no callback set 2023-11-01T03:19:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 5 monclient: authenticate success, global_id 4327 2023-11-01T03:19:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 10 monclient: _renew_subs 2023-11-01T03:19:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca90146140 con 0x7fca900b02b0 2023-11-01T03:19:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 10 monclient: _renew_subs 2023-11-01T03:19:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca901dae10 con 0x7fca900b02b0 2023-11-01T03:19:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.075+0000 7fca9493b640 1 librados: init done 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 10 client.4327.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 15 client.4327.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 20 client.4327.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca90071c90 con 0x7fca900b02b0 2023-11-01T03:19:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 10 monclient(hunting): handle_auth_done global_id 4290 payload 824 2023-11-01T03:19:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b00b3d80 msgr2=0x7fd2b0143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd2b00b3d80 0x7fd2b0143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b0145920 msgr2=0x7fd2b006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2b0145920 0x7fd2b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.076+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00094d0 con 0x7fd2b013aa30 2023-11-01T03:19:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.079+0000 7fd2af7fe640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 0x7fd2b006f6d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.079+0000 7fd2977fe640 10 client.?.objecter ms_handle_connect 0x7fd2b013aa30 2023-11-01T03:19:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.079+0000 7fd2977fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.079+0000 7f923a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 0x7f9234037e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 0x7f9234037e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2023-11-01T03:19:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 1 -- 172.21.15.5:0/3163992566 learned_addr learned my addr 172.21.15.5:0/3163992566 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 10 monclient(hunting): get_auth_request con 0x7f9234006f50 auth_method 0 2023-11-01T03:19:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.083+0000 7f923a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.084+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.084+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.084+0000 7f923a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 0x7f5d08146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 10 monclient(hunting): handle_auth_done global_id 4293 payload 824 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 -- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f923402c570 msgr2=0x7f92340b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f923402c570 0x7f92340b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 -- 172.21.15.5:0/3163992566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340c9410 msgr2=0x7f92340ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340c9410 0x7f92340ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f923a59c640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300094d0 con 0x7f9234006f50 2023-11-01T03:19:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 0x7f5d08146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59356/0 (socket says 172.21.15.5:59356) 2023-11-01T03:19:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 1 -- 172.21.15.5:0/879984988 learned_addr learned my addr 172.21.15.5:0/879984988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 10 monclient(hunting): get_auth_request con 0x7f5d08149190 auth_method 0 2023-11-01T03:19:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.087+0000 7f5d0d18d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.088+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.088+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.088+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.089+0000 7f5d07fff640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d08146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.090+0000 7f5fc6b3b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 0x7f5fc013a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.090+0000 7f5d07fff640 10 monclient(hunting): get_auth_request con 0x7f5d08142d80 auth_method 0 2023-11-01T03:19:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.090+0000 7f5d07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.090+0000 7f5d07fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.090+0000 7f5d07fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.092+0000 7f923a59c640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 0x7f9234037e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f92300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.092+0000 7f922affd640 10 client.?.objecter ms_handle_connect 0x7f9234006f50 2023-11-01T03:19:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.092+0000 7f922affd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 10 monclient(hunting): handle_auth_done global_id 4271 payload 824 2023-11-01T03:19:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 -- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d080af920 msgr2=0x7f5d081da990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d080af920 0x7f5d081da990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 -- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 msgr2=0x7f5d08146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d08142d80 0x7f5d08146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.093+0000 7f5d0d18d640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0094d0 con 0x7f5d08149190 2023-11-01T03:19:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0031f10 con 0x7fd2b013aa30 2023-11-01T03:19:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: dump: 2023-11-01T03:19:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.333 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0032860 con 0x7fd2b013aa30 2023-11-01T03:19:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0032c10 con 0x7fd2b013aa30 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2977fe640 10 monclient: dump: 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.337 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.094+0000 7fd2ad7fa640 4 set_mon_vals no callback set 2023-11-01T03:19:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 5 monclient: authenticate success, global_id 4290 2023-11-01T03:19:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 10 monclient: _renew_subs 2023-11-01T03:19:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b0071190 con 0x7fd2b013aa30 2023-11-01T03:19:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 10 client.4290.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 10 monclient: _renew_subs 2023-11-01T03:19:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b006fdf0 con 0x7fd2b013aa30 2023-11-01T03:19:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.095+0000 7fd2affff640 1 librados: init done 2023-11-01T03:19:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 10 client.4290.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 15 client.4290.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 20 client.4290.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 10 client.4290.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2b0070ee0 con 0x7fd2b013aa30 2023-11-01T03:19:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 0x7f5fc013a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59372/0 (socket says 172.21.15.5:59372) 2023-11-01T03:19:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/3531322010 learned_addr learned my addr 172.21.15.5:0/3531322010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 10 monclient(hunting): get_auth_request con 0x7f5fc0145330 auth_method 0 2023-11-01T03:19:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.096+0000 7f5fc6b3b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.097+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.097+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.097+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.098+0000 7f5fc5b39640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc013ed40 0x7f5fc01417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c032840 con 0x7f9b980c3d30 2023-11-01T03:19:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: dump: 2023-11-01T03:19:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.347 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0329a0 con 0x7f9b980c3d30 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c032d50 con 0x7f9b980c3d30 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b95ffb640 10 monclient: dump: 2023-11-01T03:19:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.350 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9b977fe640 4 set_mon_vals no callback set 2023-11-01T03:19:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 5 monclient: authenticate success, global_id 4287 2023-11-01T03:19:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 10 monclient: _renew_subs 2023-11-01T03:19:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980c1b30 con 0x7f9b980c3d30 2023-11-01T03:19:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 10 monclient: _renew_subs 2023-11-01T03:19:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980c3af0 con 0x7f9b980c3d30 2023-11-01T03:19:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f9ba7383640 1 librados: init done 2023-11-01T03:19:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca880145e0 con 0x7fca900b02b0 2023-11-01T03:19:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f5fc5b39640 10 monclient(hunting): get_auth_request con 0x7f5fc013ed40 auth_method 0 2023-11-01T03:19:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f5fc5b39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f5fc5b39640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.099+0000 7f5fc5b39640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 10 monclient(hunting): handle_auth_done global_id 4274 payload 824 2023-11-01T03:19:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc00b3110 msgr2=0x7f5fc00ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc00b3110 0x7f5fc00ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc013ed40 msgr2=0x7f5fc01417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc013ed40 0x7f5fc01417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009a10 con 0x7f5fc0145330 2023-11-01T03:19:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7fca777fe640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fca7c06c800 0x7fca7c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fca7c06c800 0x7fca7c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.100+0000 7fca8ed9d640 10 monclient: get_auth_request con 0x7fca7c06c800 auth_method 0 2023-11-01T03:19:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 10 client.4287.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 15 client.4287.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 20 client.4287.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b9815cc20 con 0x7f9b980c3d30 2023-11-01T03:19:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca8ed9d640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fca7c06c800 0x7fca7c06ecc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 10 client.4327.objecter ms_handle_connect 0x7fca7c06c800 2023-11-01T03:19:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca8805a040 con 0x7fca900b02b0 2023-11-01T03:19:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 10 client.4327.objecter ms_dispatch 0x7fca90000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 3 client.4327.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 3 client.4327.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 10 client.4327.objecter checking command 1 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7fca7c072be0 0x7fca7c075000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter _get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 15 client.4327.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter _get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 15 client.4327.objecter _session_command_op_assign 4 1 2023-11-01T03:19:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 4 2023-11-01T03:19:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 10 client.4327.objecter _send_command 1 2023-11-01T03:19:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca7c0756b0 con 0x7fca7c072be0 2023-11-01T03:19:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.101+0000 7fca777fe640 20 client.4327.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7f5d0d18d640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 0x7f5d08146640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000efc0 tx=0x7f5d0000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7f5d057fa640 10 client.?.objecter ms_handle_connect 0x7f5d08149190 2023-11-01T03:19:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7f5d057fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca88055c80 con 0x7fca900b02b0 2023-11-01T03:19:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7fca8e59c640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7fca7c072be0 0x7fca7c075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7fca777fe640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.102+0000 7fca8e59c640 10 monclient: get_auth_request con 0x7fca7c072be0 auth_method 0 2023-11-01T03:19:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.103+0000 7fd7cf7fe640 1 --2- 172.21.15.5:0/604838679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80d34b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7d004faa0 tx=0x7fd7d00a5980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1163c0011241ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.106+0000 7fca8e59c640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7fca7c072be0 0x7fca7c075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.106+0000 7fca777fe640 10 client.4327.objecter ms_handle_connect 0x7fca7c072be0 2023-11-01T03:19:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.106+0000 7f5fc6b3b640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 0x7f5fc013a240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8037040 tx=0x7f5fb8002350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.106+0000 7f5fb6ffd640 10 client.?.objecter ms_handle_connect 0x7f5fc0145330 2023-11-01T03:19:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.106+0000 7f5fb6ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00009ba0 con 0x7f5d08149190 2023-11-01T03:19:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: dump: 2023-11-01T03:19:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.370 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000f040 con 0x7f5d08149190 2023-11-01T03:19:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000146c0 con 0x7f5d08149190 2023-11-01T03:19:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d057fa640 10 monclient: dump: 2023-11-01T03:19:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.374 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d06ffd640 4 set_mon_vals no callback set 2023-11-01T03:19:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 5 monclient: authenticate success, global_id 4271 2023-11-01T03:19:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 10 monclient: _renew_subs 2023-11-01T03:19:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d08138340 con 0x7f5d08149190 2023-11-01T03:19:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 10 monclient: _renew_subs 2023-11-01T03:19:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d081daed0 con 0x7f5d08149190 2023-11-01T03:19:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f5d0d98e640 1 librados: init done 2023-11-01T03:19:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640721c0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: dump: 2023-11-01T03:19:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.379 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64072340 con 0x7f2d5c0083e0 2023-11-01T03:19:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64092640 con 0x7f2d5c0083e0 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d59ffb640 10 monclient: dump: 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.383 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d5b7fe640 4 set_mon_vals no callback set 2023-11-01T03:19:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d6a3a0640 5 monclient: authenticate success, global_id 4330 2023-11-01T03:19:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d6a3a0640 10 monclient: _renew_subs 2023-11-01T03:19:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d6a3a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.109+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c02c7c0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 client.4330.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 monclient: _renew_subs 2023-11-01T03:19:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c02cab0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 1 librados: init done 2023-11-01T03:19:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 10 client.4271.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 15 client.4271.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 20 client.4271.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d080afd00 con 0x7f5d08149190 2023-11-01T03:19:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230033a30 con 0x7f9234006f50 2023-11-01T03:19:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: dump: 2023-11-01T03:19:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.390 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230033b90 con 0x7f9234006f50 2023-11-01T03:19:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923003d470 con 0x7f9234006f50 2023-11-01T03:19:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f922affd640 10 monclient: dump: 2023-11-01T03:19:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.393 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.393 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 5 monclient: authenticate success, global_id 4293 2023-11-01T03:19:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 10 monclient: _renew_subs 2023-11-01T03:19:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9234036f90 con 0x7f9234006f50 2023-11-01T03:19:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 client.4330.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 15 client.4330.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 20 client.4330.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 client.4330.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d5c032410 con 0x7f2d5c0083e0 2023-11-01T03:19:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 10 monclient: _renew_subs 2023-11-01T03:19:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92340c16c0 con 0x7f9234006f50 2023-11-01T03:19:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f923b59e640 1 librados: init done 2023-11-01T03:19:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.110+0000 7f9238d99640 4 set_mon_vals no callback set 2023-11-01T03:19:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 10 client.4293.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 15 client.4293.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 20 client.4293.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.111+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92340c27e0 con 0x7f9234006f50 2023-11-01T03:19:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8040860 con 0x7f5fc0145330 2023-11-01T03:19:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: dump: 2023-11-01T03:19:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.402 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb80409c0 con 0x7f5fc0145330 2023-11-01T03:19:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8040d70 con 0x7f5fc0145330 2023-11-01T03:19:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fb6ffd640 10 monclient: dump: 2023-11-01T03:19:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.406 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 5 monclient: authenticate success, global_id 4274 2023-11-01T03:19:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 10 monclient: _renew_subs 2023-11-01T03:19:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc4b37640 4 set_mon_vals no callback set 2023-11-01T03:19:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc01413f0 con 0x7f5fc0145330 2023-11-01T03:19:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 10 client.4274.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 10 monclient: _renew_subs 2023-11-01T03:19:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc013a960 con 0x7f5fc0145330 2023-11-01T03:19:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.112+0000 7f5fc859e640 1 librados: init done 2023-11-01T03:19:12.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 10 client.4274.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 15 client.4274.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 20 client.4274.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 10 client.4274.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.113+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fc00b3570 con 0x7f5fc0145330 2023-11-01T03:19:12.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 1 -- 172.21.15.5:0/604838679 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00aa6f0 con 0x7fd7c8030b10 2023-11-01T03:19:12.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: dump: 2023-11-01T03:19:12.412 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.412 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.412 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 1 -- 172.21.15.5:0/604838679 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d00aa850 con 0x7fd7c8030b10 2023-11-01T03:19:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 1 -- 172.21.15.5:0/604838679 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00aac60 con 0x7fd7c8030b10 2023-11-01T03:19:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cffff640 5 monclient: authenticate success, global_id 4324 2023-11-01T03:19:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cffff640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cffff640 4 set_mon_vals no callback set 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.119+0000 7fd7cdffb640 10 monclient: dump: 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.418 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 10 monclient: shutdown 2023-11-01T03:19:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 -- 172.21.15.5:0/604838679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 msgr2=0x7fd7c80d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 --2- 172.21.15.5:0/604838679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80d34b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7d004faa0 tx=0x7fd7d00a5980 comp rx=0 tx=0).stop 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 -- 172.21.15.5:0/604838679 shutdown_connections 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 --2- 172.21.15.5:0/604838679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80d34b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 -- 172.21.15.5:0/604838679 >> 172.21.15.5:0/604838679 conn(0x7fd7c8006030 msgr2=0x7fd7c8006440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 -- 172.21.15.5:0/604838679 shutdown_connections 2023-11-01T03:19:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.120+0000 7fd7cffff640 1 -- 172.21.15.5:0/604838679 wait complete. 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 10 monclient: monmap: 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.420 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 librados: starting msgr at 2023-11-01T03:19:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 librados: starting objecter 2023-11-01T03:19:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 Processor -- start 2023-11-01T03:19:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 -- start start 2023-11-01T03:19:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 librados: setting wanted keys 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 1 librados: calling monclient init 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.121+0000 7fd7cffff640 10 monclient: init 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c80070e0 0x7fd7c802d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-a con 0x7fd7c80070e0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-b con 0x7fd7c8030b10 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7c8036530 0x7fd7c802f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): picked mon.noname-c con 0x7fd7c8036530 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c802f820 con 0x7fd7c80070e0 2023-11-01T03:19:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c802ec50 con 0x7fd7c8030b10 2023-11-01T03:19:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c815ff60 con 0x7fd7c8036530 2023-11-01T03:19:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.122+0000 7fd7cffff640 10 monclient(hunting): authenticate will time out at 1428.346308s 2023-11-01T03:19:12.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.132+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d640927a0 con 0x7f2d5c0083e0 2023-11-01T03:19:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.132+0000 7f2d59ffb640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2d4806c850 0x7f2d4806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.132+0000 7f2d6939e640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2d4806c850 0x7f2d4806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.132+0000 7f2d6939e640 10 monclient: get_auth_request con 0x7f2d4806c850 auth_method 0 2023-11-01T03:19:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7f2d59ffb640 10 client.4330.objecter ms_handle_connect 0x7f2d4806c850 2023-11-01T03:19:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7f2d6939e640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2d4806c850 0x7f2d4806ed10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d54006fd0 tx=0x7f2d54009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd2a004d3f0 con 0x7fd2b013aa30 2023-11-01T03:19:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7fd2977fe640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd29c06c850 0x7fd29c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7fd2aeffd640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd29c06c850 0x7fd29c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.133+0000 7fd2aeffd640 10 monclient: get_auth_request con 0x7fd29c06c850 auth_method 0 2023-11-01T03:19:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.134+0000 7fd2aeffd640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd29c06c850 0x7fd29c06ed10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006fd0 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.134+0000 7fd2977fe640 10 client.4290.objecter ms_handle_connect 0x7fd29c06c850 2023-11-01T03:19:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2d640d2640 con 0x7f2d5c0083e0 2023-11-01T03:19:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 10 client.4330.objecter ms_dispatch 0x7f2d64000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 3 client.4330.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 3 client.4330.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 10 client.4330.objecter checking command 1 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f2d48072c30 0x7f2d48075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter _get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 15 client.4330.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter _get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 15 client.4330.objecter _session_command_op_assign 2 1 2023-11-01T03:19:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 4 2023-11-01T03:19:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 10 client.4330.objecter _send_command 1 2023-11-01T03:19:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d48075700 con 0x7f2d48072c30 2023-11-01T03:19:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 20 client.4330.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d640ce280 con 0x7f2d5c0083e0 2023-11-01T03:19:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d59ffb640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.135+0000 7f2d69b9f640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f2d48072c30 0x7f2d48075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.136+0000 7f2d69b9f640 10 monclient: get_auth_request con 0x7f2d48072c30 auth_method 0 2023-11-01T03:19:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.136+0000 7fd7ce7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40786/0 (socket says 172.21.15.5:40786) 2023-11-01T03:19:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 1 -- 172.21.15.5:0/2456263165 learned_addr learned my addr 172.21.15.5:0/2456263165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): get_auth_request con 0x7fd7c8030b10 auth_method 0 2023-11-01T03:19:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.137+0000 7fd7ce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd2a007ad00 con 0x7fd2b013aa30 2023-11-01T03:19:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 10 client.4290.objecter ms_dispatch 0x7fd2b0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 3 client.4290.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 3 client.4290.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 10 client.4290.objecter checking command 1 2023-11-01T03:19:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fd29c072c30 0x7fd29c075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter _get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 15 client.4290.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter _get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 15 client.4290.objecter _session_command_op_assign 6 1 2023-11-01T03:19:12.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 4 2023-11-01T03:19:12.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 10 client.4290.objecter _send_command 1 2023-11-01T03:19:12.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd29c075700 con 0x7fd29c072c30 2023-11-01T03:19:12.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 20 client.4290.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2a0076940 con 0x7fd2b013aa30 2023-11-01T03:19:12.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.138+0000 7fd2977fe640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.139+0000 7fd2ae7fc640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fd29c072c30 0x7fd29c075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.139+0000 7f2d69b9f640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f2d48072c30 0x7f2d48075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.139+0000 7f2d59ffb640 10 client.4330.objecter ms_handle_connect 0x7f2d48072c30 2023-11-01T03:19:12.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd2ae7fc640 10 monclient: get_auth_request con 0x7fd29c072c30 auth_method 0 2023-11-01T03:19:12.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 10 monclient(hunting): handle_auth_done global_id 4336 payload 824 2023-11-01T03:19:12.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 -- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7c8036530 msgr2=0x7fd7c802f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd7c8036530 0x7fd7c802f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 -- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c80070e0 msgr2=0x7fd7c802d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c80070e0 0x7fd7c802d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.140+0000 7fd7ce7fc640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0068fc0 con 0x7fd7c8030b10 2023-11-01T03:19:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.143+0000 7fd7ce7fc640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80c85c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c4a0 tx=0x7fd7c400c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.143+0000 7fd7b77fe640 10 client.?.objecter ms_handle_connect 0x7fd7c8030b10 2023-11-01T03:19:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.143+0000 7fd7b77fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.143+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d00014820 con 0x7f5d08149190 2023-11-01T03:19:12.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.143+0000 7f5d057fa640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5cf406c850 0x7f5cf406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.144+0000 7f5d0c98c640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5cf406c850 0x7f5cf406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.144+0000 7f5d0c98c640 10 monclient: get_auth_request con 0x7f5cf406c850 auth_method 0 2023-11-01T03:19:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.144+0000 7f5d0c98c640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5cf406c850 0x7f5cf406ed10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8003cc0 tx=0x7f5cf80079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.144+0000 7f5d057fa640 10 client.4271.objecter ms_handle_connect 0x7f5cf406c850 2023-11-01T03:19:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.145+0000 7fd2ae7fc640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fd29c072c30 0x7fd29c075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.145+0000 7fd2977fe640 10 client.4290.objecter ms_handle_connect 0x7fd29c072c30 2023-11-01T03:19:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4005ce0 con 0x7fd7c8030b10 2023-11-01T03:19:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: dump: 2023-11-01T03:19:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4005e40 con 0x7fd7c8030b10 2023-11-01T03:19:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 5 monclient: authenticate success, global_id 4336 2023-11-01T03:19:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 10 monclient: _renew_subs 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c8160240 con 0x7fd7c8030b10 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4007270 con 0x7fd7c8030b10 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7b77fe640 10 monclient: dump: 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cd7fa640 4 set_mon_vals no callback set 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 10 client.4336.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 10 monclient: _renew_subs 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c8160940 con 0x7fd7c8030b10 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.147+0000 7fd7cffff640 1 librados: init done 2023-11-01T03:19:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 10 client.4336.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 15 client.4336.objecter _session_command_op_assign -1 1 2023-11-01T03:19:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 20 client.4336.objecter _get_session osd=-1 returning homeless 2023-11-01T03:19:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 10 client.4336.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.148+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7c80c56d0 con 0x7fd7c8030b10 2023-11-01T03:19:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5d00059cf0 con 0x7f5d08149190 2023-11-01T03:19:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 10 client.4271.objecter ms_dispatch 0x7f5d08000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 3 client.4271.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 3 client.4271.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 10 client.4271.objecter checking command 1 2023-11-01T03:19:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f5cf4072c30 0x7f5cf4075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter _get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 15 client.4271.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter _get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 15 client.4271.objecter _session_command_op_assign 5 1 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 4 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 10 client.4271.objecter _send_command 1 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cf4075700 con 0x7f5cf4072c30 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.149+0000 7f5d057fa640 20 client.4271.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.150+0000 7f5d07fff640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f5cf4072c30 0x7f5cf4075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.151+0000 7f5d07fff640 10 monclient: get_auth_request con 0x7f5cf4072c30 auth_method 0 2023-11-01T03:19:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7f5d07fff640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f5cf4072c30 0x7f5cf4075050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7f5d057fa640 10 client.4271.objecter ms_handle_connect 0x7f5cf4072c30 2023-11-01T03:19:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== osd.4 v2:172.21.15.153:6824/439822656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fca7c0756b0 con 0x7fca7c072be0 2023-11-01T03:19:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7fca777fe640 10 client.4327.objecter ms_dispatch 0x7fca90000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7fca777fe640 10 client.4327.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7fca777fe640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 4 2023-11-01T03:19:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.155+0000 7fca777fe640 15 client.4327.objecter _session_command_op_remove 4 1 2023-11-01T03:19:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.159+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9b9c04e470 con 0x7f9b980c3d30 2023-11-01T03:19:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.159+0000 7f9b95ffb640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f9b8406c830 0x7f9b8406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.159+0000 7f9ba511f640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f9b8406c830 0x7f9b8406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.160+0000 7f9ba511f640 10 monclient: get_auth_request con 0x7f9b8406c830 auth_method 0 2023-11-01T03:19:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.160+0000 7f9ba511f640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f9b8406c830 0x7f9b8406ecf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0079c70 tx=0x7f9ba006d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.160+0000 7f9b95ffb640 10 client.4287.objecter ms_handle_connect 0x7f9b8406c830 2023-11-01T03:19:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.162+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b9c07a830 con 0x7f9b980c3d30 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.162+0000 7f9b95ffb640 10 client.4287.objecter ms_dispatch 0x7f9ba0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.162+0000 7f9b95ffb640 3 client.4287.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.162+0000 7f9b95ffb640 3 client.4287.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 10 client.4287.objecter checking command 1 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f9b84072c10 0x7f9b84075030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter _get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 15 client.4287.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter _get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 15 client.4287.objecter _session_command_op_assign 0 1 2023-11-01T03:19:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 4 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 10 client.4287.objecter _send_command 1 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b840756e0 con 0x7f9b84072c10 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 20 client.4287.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9c076470 con 0x7f9b980c3d30 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.163+0000 7f9b95ffb640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.164+0000 7f9ba491e640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f9b84072c10 0x7f9b84075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.164+0000 7f9ba491e640 10 monclient: get_auth_request con 0x7f9b84072c10 auth_method 0 2023-11-01T03:19:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.168+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd7c4007490 con 0x7fd7c8030b10 2023-11-01T03:19:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.168+0000 7fd7b77fe640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd7bc06c850 0x7fd7bc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7fd7ceffd640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd7bc06c850 0x7fd7bc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7fd7ceffd640 10 monclient: get_auth_request con 0x7fd7bc06c850 auth_method 0 2023-11-01T03:19:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7f9ba491e640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f9b84072c10 0x7f9b84075030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7f9b95ffb640 10 client.4287.objecter ms_handle_connect 0x7f9b84072c10 2023-11-01T03:19:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7fd7ceffd640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd7bc06c850 0x7fd7bc06ed10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0006fd0 tx=0x7fd7c0006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.169+0000 7fd7b77fe640 10 client.4336.objecter ms_handle_connect 0x7fd7bc06c850 2023-11-01T03:19:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd7c4058090 con 0x7fd7c8030b10 2023-11-01T03:19:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 10 client.4336.objecter ms_dispatch 0x7fd7d0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 3 client.4336.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 3 client.4336.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 10 client.4336.objecter checking command 1 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7fd7bc072c30 0x7fd7bc075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter _get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 15 client.4336.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter _get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 15 client.4336.objecter _session_command_op_assign 3 1 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 4 2023-11-01T03:19:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 10 client.4336.objecter _send_command 1 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7bc075700 con 0x7fd7bc072c30 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7b77fe640 20 client.4336.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.172+0000 7fd7cf7fe640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7fd7bc072c30 0x7fd7bc075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.173+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7c4001200 con 0x7fd7c8030b10 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.173+0000 7fd7b77fe640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.173+0000 7fd7cf7fe640 10 monclient: get_auth_request con 0x7fd7bc072c30 auth_method 0 2023-11-01T03:19:12.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.177+0000 7fd7cf7fe640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7fd7bc072c30 0x7fd7bc075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.177+0000 7fd7b77fe640 10 client.4336.objecter ms_handle_connect 0x7fd7bc072c30 2023-11-01T03:19:12.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 10 client.4327.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 15 client.4327.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 20 client.4327.objecter _get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 20 client.4327.objecter _get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 15 client.4327.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 20 client.4327.objecter get_session s=0x7fca7c072510 osd=4 3 2023-11-01T03:19:12.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 15 client.4327.objecter _session_command_op_assign 4 2 2023-11-01T03:19:12.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 4 2023-11-01T03:19:12.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 10 client.4327.objecter _send_command 2 2023-11-01T03:19:12.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 --> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca9006fe30 con 0x7fca7c072be0 2023-11-01T03:19:12.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.181+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d00055930 con 0x7f5d08149190 2023-11-01T03:19:12.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.181+0000 7f5d057fa640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.181+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fb8032440 con 0x7f5fc0145330 2023-11-01T03:19:12.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5fa406c800 0x7f5fa406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7f5fc633a640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5fa406c800 0x7f5fa406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.182+0000 7f5fc633a640 10 monclient: get_auth_request con 0x7f5fa406c800 auth_method 0 2023-11-01T03:19:12.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.183+0000 7f5fc633a640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5fa406c800 0x7f5fa406ecc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc006fd0 tx=0x7f5fbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.183+0000 7f5fb6ffd640 10 client.4274.objecter ms_handle_connect 0x7f5fa406c800 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fb807c630 con 0x7f5fc0145330 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 10 client.4274.objecter ms_dispatch 0x7f5fc0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 3 client.4274.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 3 client.4274.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 10 client.4274.objecter checking command 1 2023-11-01T03:19:12.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f5fa4072be0 0x7f5fa4075000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter _get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 15 client.4274.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter _get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 15 client.4274.objecter _session_command_op_assign 7 1 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 4 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 10 client.4274.objecter _send_command 1 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fa40756b0 con 0x7f5fa4072be0 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 20 client.4274.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb8078270 con 0x7f5fc0145330 2023-11-01T03:19:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.187+0000 7f5fb6ffd640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.188+0000 7f5fc5b39640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f5fa4072be0 0x7f5fa4075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.189+0000 7f5fc5b39640 10 monclient: get_auth_request con 0x7f5fa4072be0 auth_method 0 2023-11-01T03:19:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.192+0000 7fca777fe640 1 -- 172.21.15.5:0/3828019467 <== osd.4 v2:172.21.15.153:6824/439822656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca84009840 con 0x7fca7c072be0 2023-11-01T03:19:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.192+0000 7fca777fe640 10 client.4327.objecter ms_dispatch 0x7fca90000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.192+0000 7fca777fe640 10 client.4327.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.192+0000 7fca777fe640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 4 2023-11-01T03:19:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.192+0000 7fca777fe640 15 client.4327.objecter _session_command_op_remove 4 2 2023-11-01T03:19:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 10 librados: watch_flush enter 2023-11-01T03:19:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 10 librados: watch_flush exit 2023-11-01T03:19:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 10 client.4327.objecter close_session for osd.4 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7fca7c072be0 msgr2=0x7fca7c075000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7fca7c072be0 0x7fca7c075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 20 client.4327.objecter put_session s=0x7fca7c072510 osd=4 1 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 20 client.4327.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 10 client.4327.objecter successfully canceled tick 2023-11-01T03:19:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fca7c06c800 msgr2=0x7fca7c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fca7c06c800 0x7fca7c06ecc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003c040 comp rx=0 tx=0).stop 2023-11-01T03:19:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 10 monclient: shutdown 2023-11-01T03:19:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 msgr2=0x7fca900af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 --2- 172.21.15.5:0/3828019467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca900b02b0 0x7fca900af5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ebe0 tx=0x7fca8800c490 comp rx=0 tx=0).stop 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca8f59e640 1 -- 172.21.15.5:0/3828019467 reap_dead start 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 shutdown_connections 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 >> 172.21.15.5:0/3828019467 conn(0x7fca900b2ca0 msgr2=0x7fca9013bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 shutdown_connections 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 -- 172.21.15.5:0/3828019467 wait complete. 2023-11-01T03:19:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.193+0000 7fca9493b640 1 librados: shutdown 2023-11-01T03:19:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== osd.6 v2:172.21.15.153:6800/1447491004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd29c075700 con 0x7fd29c072c30 2023-11-01T03:19:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7fd2977fe640 10 client.4290.objecter ms_dispatch 0x7fd2b0000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7fd2977fe640 10 client.4290.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7fd2977fe640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 4 2023-11-01T03:19:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7fd2977fe640 15 client.4290.objecter _session_command_op_remove 6 1 2023-11-01T03:19:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7f5fc5b39640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f5fa4072be0 0x7f5fa4075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.195+0000 7f5fb6ffd640 10 client.4274.objecter ms_handle_connect 0x7f5fa4072be0 2023-11-01T03:19:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.198+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== osd.2 v2:172.21.15.5:6818/4138368784 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2d48075700 con 0x7f2d48072c30 2023-11-01T03:19:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.198+0000 7f2d59ffb640 10 client.4330.objecter ms_dispatch 0x7f2d64000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.198+0000 7f2d59ffb640 10 client.4330.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.198+0000 7f2d59ffb640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 4 2023-11-01T03:19:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.198+0000 7f2d59ffb640 15 client.4330.objecter _session_command_op_remove 2 1 2023-11-01T03:19:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.201+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f923003a040 con 0x7f9234006f50 2023-11-01T03:19:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.202+0000 7f922affd640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f921c06c850 0x7f921c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.202+0000 7f9239d9b640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f921c06c850 0x7f921c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.202+0000 7f9239d9b640 10 monclient: get_auth_request con 0x7f921c06c850 auth_method 0 2023-11-01T03:19:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f9239d9b640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f921c06c850 0x7f921c06ed10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92340cf5c0 tx=0x7f922c007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f922affd640 10 client.4293.objecter ms_handle_connect 0x7f921c06c850 2023-11-01T03:19:12.496 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-01T03:19:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== osd.5 v2:172.21.15.153:6816/3310991586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5cf4075700 con 0x7f5cf4072c30 2023-11-01T03:19:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f5d057fa640 10 client.4271.objecter ms_dispatch 0x7f5d08000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f5d057fa640 10 client.4271.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f5d057fa640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 4 2023-11-01T03:19:12.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.203+0000 7f5d057fa640 15 client.4271.objecter _session_command_op_remove 5 1 2023-11-01T03:19:12.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-01T03:19:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9230051380 con 0x7f9234006f50 2023-11-01T03:19:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 10 client.4293.objecter ms_dispatch 0x7f923c000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 3 client.4293.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 3 client.4293.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 10 client.4293.objecter checking command 1 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f921c072ba0 0x7f921c074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter _get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 15 client.4293.objecter _session_command_op_remove -1 1 2023-11-01T03:19:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter _get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 15 client.4293.objecter _session_command_op_assign 1 1 2023-11-01T03:19:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 4 2023-11-01T03:19:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 10 client.4293.objecter _send_command 1 2023-11-01T03:19:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f921c075670 con 0x7f921c072ba0 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 20 client.4293.objecter dump_active .. 0 homeless 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f923002f020 con 0x7f9234006f50 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.206+0000 7f922affd640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.207+0000 7f923ad9d640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f921c072ba0 0x7f921c074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.207+0000 7f923ad9d640 10 monclient: get_auth_request con 0x7f921c072ba0 auth_method 0 2023-11-01T03:19:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.212+0000 7f923ad9d640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f921c072ba0 0x7f921c074fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.212+0000 7f922affd640 10 client.4293.objecter ms_handle_connect 0x7f921c072ba0 2023-11-01T03:19:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 10 client.4290.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 15 client.4290.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 20 client.4290.objecter _get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 20 client.4290.objecter _get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 15 client.4290.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 20 client.4290.objecter get_session s=0x7fd29c072560 osd=6 3 2023-11-01T03:19:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 15 client.4290.objecter _session_command_op_assign 6 2 2023-11-01T03:19:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 4 2023-11-01T03:19:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 10 client.4290.objecter _send_command 2 2023-11-01T03:19:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.220+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 --> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2b0142390 con 0x7fd29c072c30 2023-11-01T03:19:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2977fe640 1 -- 172.21.15.5:0/3190114616 <== osd.6 v2:172.21.15.153:6800/1447491004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2a8001850 con 0x7fd29c072c30 2023-11-01T03:19:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2977fe640 10 client.4290.objecter ms_dispatch 0x7fd2b0000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2977fe640 10 client.4290.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2977fe640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 4 2023-11-01T03:19:12.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2977fe640 15 client.4290.objecter _session_command_op_remove 6 2 2023-11-01T03:19:12.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 10 librados: watch_flush enter 2023-11-01T03:19:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 10 librados: watch_flush exit 2023-11-01T03:19:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 10 client.4290.objecter close_session for osd.6 2023-11-01T03:19:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fd29c072c30 msgr2=0x7fd29c075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fd29c072c30 0x7fd29c075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 20 client.4290.objecter put_session s=0x7fd29c072560 osd=6 1 2023-11-01T03:19:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 20 client.4290.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 10 client.4290.objecter successfully canceled tick 2023-11-01T03:19:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd29c06c850 msgr2=0x7fd29c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd29c06c850 0x7fd29c06ed10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006fd0 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2023-11-01T03:19:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 10 monclient: shutdown 2023-11-01T03:19:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 msgr2=0x7fd2b006f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 --2- 172.21.15.5:0/3190114616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b013aa30 0x7fd2b006f6d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009870 tx=0x7fd2a00046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2af7fe640 1 -- 172.21.15.5:0/3190114616 reap_dead start 2023-11-01T03:19:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 shutdown_connections 2023-11-01T03:19:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.229+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 >> 172.21.15.5:0/3190114616 conn(0x7fd2b0065cd0 msgr2=0x7fd2b00b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 shutdown_connections 2023-11-01T03:19:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7fd2affff640 1 -- 172.21.15.5:0/3190114616 wait complete. 2023-11-01T03:19:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7fd2affff640 1 librados: shutdown 2023-11-01T03:19:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 10 client.4330.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 15 client.4330.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 20 client.4330.objecter _get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 20 client.4330.objecter _get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 15 client.4330.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 20 client.4330.objecter get_session s=0x7f2d48072560 osd=2 3 2023-11-01T03:19:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 15 client.4330.objecter _session_command_op_assign 2 2 2023-11-01T03:19:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 4 2023-11-01T03:19:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 10 client.4330.objecter _send_command 2 2023-11-01T03:19:12.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.230+0000 7f2d6a3a0640 1 -- 172.21.15.5:0/2699820507 --> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d5c033520 con 0x7f2d48072c30 2023-11-01T03:19:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.233+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== osd.0 v2:172.21.15.5:6802/1232325411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9b840756e0 con 0x7f9b84072c10 2023-11-01T03:19:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.233+0000 7f9b95ffb640 10 client.4287.objecter ms_dispatch 0x7f9ba0000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.233+0000 7f9b95ffb640 10 client.4287.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.233+0000 7f9b95ffb640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 4 2023-11-01T03:19:12.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.233+0000 7f9b95ffb640 15 client.4287.objecter _session_command_op_remove 0 1 2023-11-01T03:19:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 10 client.4271.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 15 client.4271.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 20 client.4271.objecter _get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 20 client.4271.objecter _get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 15 client.4271.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 20 client.4271.objecter get_session s=0x7f5cf4072560 osd=5 3 2023-11-01T03:19:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 15 client.4271.objecter _session_command_op_assign 5 2 2023-11-01T03:19:12.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 4 2023-11-01T03:19:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 10 client.4271.objecter _send_command 2 2023-11-01T03:19:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.236+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 --> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d0804e9f0 con 0x7f5cf4072c30 2023-11-01T03:19:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.237+0000 7f2d59ffb640 1 -- 172.21.15.5:0/2699820507 <== osd.2 v2:172.21.15.5:6818/4138368784 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d60031a20 con 0x7f2d48072c30 2023-11-01T03:19:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.237+0000 7f2d59ffb640 10 client.4330.objecter ms_dispatch 0x7f2d64000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.237+0000 7f2d59ffb640 10 client.4330.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.237+0000 7f2d59ffb640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 4 2023-11-01T03:19:12.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.237+0000 7f2d59ffb640 15 client.4330.objecter _session_command_op_remove 2 2 2023-11-01T03:19:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 10 librados: watch_flush enter 2023-11-01T03:19:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 10 librados: watch_flush exit 2023-11-01T03:19:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 10 client.4330.objecter close_session for osd.2 2023-11-01T03:19:12.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f2d48072c30 msgr2=0x7f2d48075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f2d48072c30 0x7f2d48075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 20 client.4330.objecter put_session s=0x7f2d48072560 osd=2 1 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 20 client.4330.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 10 client.4330.objecter successfully canceled tick 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2d4806c850 msgr2=0x7f2d4806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2d4806c850 0x7f2d4806ed10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d54006fd0 tx=0x7f2d54009060 comp rx=0 tx=0).stop 2023-11-01T03:19:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 10 monclient: shutdown 2023-11-01T03:19:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 msgr2=0x7f2d5c153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d477fe640 1 --2- 172.21.15.5:0/2699820507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d5c0083e0 0x7f2d5c153780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d64073590 tx=0x7f2d64067250 comp rx=0 tx=0).stop 2023-11-01T03:19:12.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.238+0000 7f2d69b9f640 1 -- 172.21.15.5:0/2699820507 reap_dead start 2023-11-01T03:19:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.239+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 shutdown_connections 2023-11-01T03:19:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.239+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 >> 172.21.15.5:0/2699820507 conn(0x7f2d5c006f70 msgr2=0x7f2d5c03a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.239+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 shutdown_connections 2023-11-01T03:19:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.239+0000 7f2d477fe640 1 -- 172.21.15.5:0/2699820507 wait complete. 2023-11-01T03:19:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.239+0000 7f2d477fe640 1 librados: shutdown 2023-11-01T03:19:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d057fa640 1 -- 172.21.15.5:0/879984988 <== osd.5 v2:172.21.15.153:6816/3310991586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d0804e9f0 con 0x7f5cf4072c30 2023-11-01T03:19:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d057fa640 10 client.4271.objecter ms_dispatch 0x7f5d08000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d057fa640 10 client.4271.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d057fa640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 4 2023-11-01T03:19:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d057fa640 15 client.4271.objecter _session_command_op_remove 5 2 2023-11-01T03:19:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== osd.7 v2:172.21.15.153:6808/1714004960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5fa40756b0 con 0x7f5fa4072be0 2023-11-01T03:19:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5fb6ffd640 10 client.4274.objecter ms_dispatch 0x7f5fc0000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5fb6ffd640 10 client.4274.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5fb6ffd640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 4 2023-11-01T03:19:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5fb6ffd640 15 client.4274.objecter _session_command_op_remove 7 1 2023-11-01T03:19:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 10 librados: watch_flush enter 2023-11-01T03:19:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 10 librados: watch_flush exit 2023-11-01T03:19:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 10 client.4271.objecter close_session for osd.5 2023-11-01T03:19:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f5cf4072c30 msgr2=0x7f5cf4075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f5cf4072c30 0x7f5cf4075050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 20 client.4271.objecter put_session s=0x7f5cf4072560 osd=5 1 2023-11-01T03:19:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 20 client.4271.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.242+0000 7f5d0d98e640 10 client.4271.objecter successfully canceled tick 2023-11-01T03:19:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5cf406c850 msgr2=0x7f5cf406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5cf406c850 0x7f5cf406ed10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8003cc0 tx=0x7f5cf80079b0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 10 monclient: shutdown 2023-11-01T03:19:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 msgr2=0x7f5d08146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 --2- 172.21.15.5:0/879984988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5d08149190 0x7f5d08146640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000efc0 tx=0x7f5d0000c490 comp rx=0 tx=0).stop 2023-11-01T03:19:12.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d18d640 1 -- 172.21.15.5:0/879984988 reap_dead start 2023-11-01T03:19:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 shutdown_connections 2023-11-01T03:19:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 >> 172.21.15.5:0/879984988 conn(0x7f5d0806aee0 msgr2=0x7f5d0813bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 shutdown_connections 2023-11-01T03:19:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.243+0000 7f5d0d98e640 1 -- 172.21.15.5:0/879984988 wait complete. 2023-11-01T03:19:12.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.245+0000 7f5d0d98e640 1 librados: shutdown 2023-11-01T03:19:12.533 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-11-01T03:19:12.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-01T03:19:12.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.248+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== osd.3 v2:172.21.15.5:6810/3809490384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd7bc075700 con 0x7fd7bc072c30 2023-11-01T03:19:12.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.248+0000 7fd7b77fe640 10 client.4336.objecter ms_dispatch 0x7fd7d0000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.248+0000 7fd7b77fe640 10 client.4336.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.248+0000 7fd7b77fe640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 4 2023-11-01T03:19:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.248+0000 7fd7b77fe640 15 client.4336.objecter _session_command_op_remove 3 1 2023-11-01T03:19:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 10 client.4287.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 15 client.4287.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 20 client.4287.objecter _get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 20 client.4287.objecter _get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 15 client.4287.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 20 client.4287.objecter get_session s=0x7f9b84072540 osd=0 3 2023-11-01T03:19:12.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 15 client.4287.objecter _session_command_op_assign 0 2 2023-11-01T03:19:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 4 2023-11-01T03:19:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 10 client.4287.objecter _send_command 2 2023-11-01T03:19:12.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.253+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 --> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b98033560 con 0x7f9b84072c10 2023-11-01T03:19:12.538 INFO:teuthology.orchestra.run.smithi005.stdout:73014444037 2023-11-01T03:19:12.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-01T03:19:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 10 client.4274.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 15 client.4274.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 20 client.4274.objecter _get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 20 client.4274.objecter _get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 15 client.4274.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 20 client.4274.objecter get_session s=0x7f5fa4072510 osd=7 3 2023-11-01T03:19:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 15 client.4274.objecter _session_command_op_assign 7 2 2023-11-01T03:19:12.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 4 2023-11-01T03:19:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 10 client.4274.objecter _send_command 2 2023-11-01T03:19:12.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.258+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fc01422e0 con 0x7f5fa4072be0 2023-11-01T03:19:12.541 INFO:teuthology.orchestra.run.smithi005.stdout:64424509446 2023-11-01T03:19:12.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-01T03:19:12.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9b95ffb640 1 -- 172.21.15.5:0/2086560271 <== osd.0 v2:172.21.15.5:6802/1232325411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b98033560 con 0x7f9b84072c10 2023-11-01T03:19:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9b95ffb640 10 client.4287.objecter ms_dispatch 0x7f9ba0000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9b95ffb640 10 client.4287.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9b95ffb640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 4 2023-11-01T03:19:12.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9b95ffb640 15 client.4287.objecter _session_command_op_remove 0 2 2023-11-01T03:19:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 10 librados: watch_flush enter 2023-11-01T03:19:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 10 librados: watch_flush exit 2023-11-01T03:19:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 10 client.4287.objecter close_session for osd.0 2023-11-01T03:19:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f9b84072c10 msgr2=0x7f9b84075030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f9b84072c10 0x7f9b84075030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 20 client.4287.objecter put_session s=0x7f9b84072540 osd=0 1 2023-11-01T03:19:12.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 20 client.4287.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 10 client.4287.objecter successfully canceled tick 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f9b8406c830 msgr2=0x7f9b8406ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f9b8406c830 0x7f9b8406ecf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0079c70 tx=0x7f9ba006d040 comp rx=0 tx=0).stop 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 10 monclient: shutdown 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 msgr2=0x7f9b9815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 --2- 172.21.15.5:0/2086560271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b980c3d30 0x7f9b9815cf00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b98007760 tx=0x7f9b9c0046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba5920640 1 -- 172.21.15.5:0/2086560271 reap_dead start 2023-11-01T03:19:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 shutdown_connections 2023-11-01T03:19:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.260+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 >> 172.21.15.5:0/2086560271 conn(0x7f9b980060d0 msgr2=0x7f9b98038680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.261+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 shutdown_connections 2023-11-01T03:19:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.261+0000 7f9ba7383640 1 -- 172.21.15.5:0/2086560271 wait complete. 2023-11-01T03:19:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.261+0000 7f9ba7383640 1 librados: shutdown 2023-11-01T03:19:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/3531322010 <== osd.7 v2:172.21.15.153:6808/1714004960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fc01422e0 con 0x7f5fa4072be0 2023-11-01T03:19:12.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fb6ffd640 10 client.4274.objecter ms_dispatch 0x7f5fc0000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fb6ffd640 10 client.4274.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fb6ffd640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 4 2023-11-01T03:19:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fb6ffd640 15 client.4274.objecter _session_command_op_remove 7 2 2023-11-01T03:19:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 10 librados: watch_flush enter 2023-11-01T03:19:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 10 librados: watch_flush exit 2023-11-01T03:19:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 10 client.4274.objecter close_session for osd.7 2023-11-01T03:19:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f5fa4072be0 msgr2=0x7f5fa4075000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f5fa4072be0 0x7f5fa4075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 20 client.4274.objecter put_session s=0x7f5fa4072510 osd=7 1 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 20 client.4274.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 10 client.4274.objecter successfully canceled tick 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5fa406c800 msgr2=0x7f5fa406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5fa406c800 0x7f5fa406ecc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc006fd0 tx=0x7f5fbc008040 comp rx=0 tx=0).stop 2023-11-01T03:19:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 10 monclient: shutdown 2023-11-01T03:19:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 msgr2=0x7f5fc013a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc859e640 1 --2- 172.21.15.5:0/3531322010 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5fc0145330 0x7f5fc013a240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8037040 tx=0x7f5fb8002350 comp rx=0 tx=0).stop 2023-11-01T03:19:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.265+0000 7f5fc6b3b640 1 -- 172.21.15.5:0/3531322010 reap_dead start 2023-11-01T03:19:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.266+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 shutdown_connections 2023-11-01T03:19:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.266+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 >> 172.21.15.5:0/3531322010 conn(0x7f5fc00b6f00 msgr2=0x7f5fc00b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.266+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 shutdown_connections 2023-11-01T03:19:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.266+0000 7f5fc859e640 1 -- 172.21.15.5:0/3531322010 wait complete. 2023-11-01T03:19:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.267+0000 7f5fc859e640 1 librados: shutdown 2023-11-01T03:19:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 10 client.4336.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 15 client.4336.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 20 client.4336.objecter _get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 20 client.4336.objecter _get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 15 client.4336.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 20 client.4336.objecter get_session s=0x7fd7bc072560 osd=3 3 2023-11-01T03:19:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 15 client.4336.objecter _session_command_op_assign 3 2 2023-11-01T03:19:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 4 2023-11-01T03:19:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 10 client.4336.objecter _send_command 2 2023-11-01T03:19:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.268+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 --> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7c80c7ea0 con 0x7fd7bc072c30 2023-11-01T03:19:12.557 INFO:teuthology.orchestra.run.smithi005.stdout:68719476742 2023-11-01T03:19:12.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-01T03:19:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== osd.1 v2:172.21.15.5:6826/1708816016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f921c075670 con 0x7f921c072ba0 2023-11-01T03:19:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7f922affd640 10 client.4293.objecter ms_dispatch 0x7f923c000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:19:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7f922affd640 10 client.4293.objecter _finish_command 1 = system:0 2023-11-01T03:19:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7f922affd640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 4 2023-11-01T03:19:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7f922affd640 15 client.4293.objecter _session_command_op_remove 1 1 2023-11-01T03:19:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7fd7b77fe640 1 -- 172.21.15.5:0/2456263165 <== osd.3 v2:172.21.15.5:6810/3809490384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7c80c7ea0 con 0x7fd7bc072c30 2023-11-01T03:19:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7fd7b77fe640 10 client.4336.objecter ms_dispatch 0x7fd7d0000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7fd7b77fe640 10 client.4336.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7fd7b77fe640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 4 2023-11-01T03:19:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.277+0000 7fd7b77fe640 15 client.4336.objecter _session_command_op_remove 3 2 2023-11-01T03:19:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 10 librados: watch_flush enter 2023-11-01T03:19:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 10 librados: watch_flush exit 2023-11-01T03:19:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 10 client.4336.objecter close_session for osd.3 2023-11-01T03:19:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7fd7bc072c30 msgr2=0x7fd7bc075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7fd7bc072c30 0x7fd7bc075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 20 client.4336.objecter put_session s=0x7fd7bc072560 osd=3 1 2023-11-01T03:19:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 20 client.4336.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 10 client.4336.objecter successfully canceled tick 2023-11-01T03:19:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd7bc06c850 msgr2=0x7fd7bc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd7bc06c850 0x7fd7bc06ed10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0006fd0 tx=0x7fd7c0006bc0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 10 monclient: shutdown 2023-11-01T03:19:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 msgr2=0x7fd7c80c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 --2- 172.21.15.5:0/2456263165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c8030b10 0x7fd7c80c85c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c4a0 tx=0x7fd7c400c960 comp rx=0 tx=0).stop 2023-11-01T03:19:12.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cf7fe640 1 -- 172.21.15.5:0/2456263165 reap_dead start 2023-11-01T03:19:12.565 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2023-11-01T03:19:12.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-01T03:19:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 shutdown_connections 2023-11-01T03:19:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 >> 172.21.15.5:0/2456263165 conn(0x7fd7c8006030 msgr2=0x7fd7c8006410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 shutdown_connections 2023-11-01T03:19:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 -- 172.21.15.5:0/2456263165 wait complete. 2023-11-01T03:19:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.278+0000 7fd7cffff640 1 librados: shutdown 2023-11-01T03:19:12.568 INFO:teuthology.orchestra.run.smithi005.stdout:68719476741 2023-11-01T03:19:12.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-01T03:19:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 10 client.4293.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-01T03:19:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 15 client.4293.objecter _session_command_op_assign -1 2 2023-11-01T03:19:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 20 client.4293.objecter _get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 20 client.4293.objecter _get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 15 client.4293.objecter _session_command_op_remove -1 2 2023-11-01T03:19:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 20 client.4293.objecter get_session s=0x7f921c0724d0 osd=1 3 2023-11-01T03:19:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 15 client.4293.objecter _session_command_op_assign 1 2 2023-11-01T03:19:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 4 2023-11-01T03:19:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 10 client.4293.objecter _send_command 2 2023-11-01T03:19:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.292+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 --> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92340bc7f0 con 0x7f921c072ba0 2023-11-01T03:19:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f922affd640 1 -- 172.21.15.5:0/3163992566 <== osd.1 v2:172.21.15.5:6826/1708816016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f923c074d40 con 0x7f921c072ba0 2023-11-01T03:19:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f922affd640 10 client.4293.objecter ms_dispatch 0x7f923c000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:19:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f922affd640 10 client.4293.objecter _finish_command 2 = system:0 2023-11-01T03:19:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f922affd640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 4 2023-11-01T03:19:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f922affd640 15 client.4293.objecter _session_command_op_remove 1 2 2023-11-01T03:19:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 10 librados: watch_flush enter 2023-11-01T03:19:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 10 librados: watch_flush exit 2023-11-01T03:19:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 10 client.4293.objecter close_session for osd.1 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f921c072ba0 msgr2=0x7f921c074fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f921c072ba0 0x7f921c074fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 20 client.4293.objecter put_session s=0x7f921c0724d0 osd=1 1 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 20 client.4293.objecter shutdown clearing up homeless session... 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.298+0000 7f923b59e640 10 client.4293.objecter successfully canceled tick 2023-11-01T03:19:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f921c06c850 msgr2=0x7f921c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f921c06c850 0x7f921c06ed10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92340cf5c0 tx=0x7f922c007990 comp rx=0 tx=0).stop 2023-11-01T03:19:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 10 monclient: shutdown 2023-11-01T03:19:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 msgr2=0x7f9234037e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 --2- 172.21.15.5:0/3163992566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9234006f50 0x7f9234037e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9230009870 tx=0x7f92300046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923ad9d640 1 -- 172.21.15.5:0/3163992566 reap_dead start 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 shutdown_connections 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 >> 172.21.15.5:0/3163992566 conn(0x7f9234005da0 msgr2=0x7f92340c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 shutdown_connections 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 -- 172.21.15.5:0/3163992566 wait complete. 2023-11-01T03:19:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.299+0000 7f923b59e640 1 librados: shutdown 2023-11-01T03:19:12.578 INFO:teuthology.orchestra.run.smithi005.stdout:68719476741 2023-11-01T03:19:12.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-01T03:19:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.762+0000 7fd308f63640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.762+0000 7fd308f63640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.762+0000 7fd308f63640 10 monclient: monmap: 2023-11-01T03:19:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.763843+0000 2023-11-01T03:19:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.763843+0000 2023-11-01T03:19:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.764+0000 7fd308f63640 1 Processor -- start 2023-11-01T03:19:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.765+0000 7fd308f63640 1 -- start start 2023-11-01T03:19:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.765+0000 7fd308f63640 10 monclient: init 2023-11-01T03:19:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2023-11-01T03:19:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd30406dd60 0x7fd30413a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-c con 0x7fd30406dd60 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd30413ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-b con 0x7fd30406eae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd304070890 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30413b190 con 0x7fd304070890 2023-11-01T03:19:12.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30406fad0 con 0x7fd30406dd60 2023-11-01T03:19:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30406e140 con 0x7fd30406eae0 2023-11-01T03:19:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.766+0000 7fd308f63640 10 monclient(hunting): authenticate will time out at 1428.990162s 2023-11-01T03:19:12.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd30413ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd3037fe640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd30406dd60 0x7fd30413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd30413ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59390/0 (socket says 172.21.15.5:59390) 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 1 -- 172.21.15.5:0/1926521703 learned_addr learned my addr 172.21.15.5:0/1926521703 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 10 monclient(hunting): get_auth_request con 0x7fd30406eae0 auth_method 0 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.767+0000 7fd302ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): get_auth_request con 0x7fd30406dd60 auth_method 0 2023-11-01T03:19:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.768+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.769+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.769+0000 7fd302ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.769+0000 7fd302ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.769+0000 7fd302ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.769+0000 7f210bfff640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.770+0000 7f210bfff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.770+0000 7f210bfff640 10 monclient: monmap: 2023-11-01T03:19:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.770954+0000 2023-11-01T03:19:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.770954+0000 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.781 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 10 monclient(hunting): handle_auth_done global_id 4339 payload 274 2023-11-01T03:19:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 1 -- 172.21.15.5:0/1926521703 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 msgr2=0x7fd30413ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 1 --2- 172.21.15.5:0/1926521703 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd30413ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 1 -- 172.21.15.5:0/1926521703 >> v1:172.21.15.153:6789/0 conn(0x7fd304070890 legacy=0x7fd304070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.771+0000 7fd3037fe640 1 -- 172.21.15.5:0/1926521703 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30406fcd0 con 0x7fd30406dd60 2023-11-01T03:19:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.772+0000 7f210bfff640 1 Processor -- start 2023-11-01T03:19:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.773+0000 7f210bfff640 1 -- start start 2023-11-01T03:19:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.773+0000 7f210bfff640 10 monclient: init 2023-11-01T03:19:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.773+0000 7f210bfff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2023-11-01T03:19:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21040070e0 0x7f2104035e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f21040070e0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2104030b10 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2104033d10 0x7f2104036360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f2104033d10 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21040355f0 con 0x7f2104030b10 2023-11-01T03:19:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21040074c0 con 0x7f2104033d10 2023-11-01T03:19:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2104037580 con 0x7f21040070e0 2023-11-01T03:19:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.774+0000 7f210bfff640 10 monclient(hunting): authenticate will time out at 1428.998110s 2023-11-01T03:19:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.776+0000 7fd3037fe640 1 --2- 172.21.15.5:0/1926521703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30406dd60 0x7fd30413a710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c840 tx=0x7fd2f802c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcef0e71f18151f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.776+0000 7f210a7fc640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2104030b10 0x7f2104033600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:55554/0 (socket says 172.21.15.5:55554) 2023-11-01T03:19:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.776+0000 7f210a7fc640 1 -- 172.21.15.5:0/2235450960 learned_addr learned my addr 172.21.15.5:0/2235450960 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.777+0000 7fc5fc290640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.777+0000 7fc5fc290640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.777+0000 7fc5fc290640 10 monclient: monmap: 2023-11-01T03:19:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.778285+0000 2023-11-01T03:19:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.778285+0000 2023-11-01T03:19:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.793 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.777+0000 7f210b7fe640 1 --2- 172.21.15.5:0/2235450960 >> v2:172.21.15.153:3300/0 conn(0x7f2104033d10 0x7f2104036360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.778+0000 7fc5fc290640 1 Processor -- start 2023-11-01T03:19:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.778+0000 7fc5fc290640 1 -- start start 2023-11-01T03:19:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.778+0000 7fc5fc290640 10 monclient: init 2023-11-01T03:19:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7f210b7fe640 10 monclient(hunting): get_auth_request con 0x7f2104033d10 auth_method 0 2023-11-01T03:19:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2023-11-01T03:19:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5f40ae4d0 0x7fc5f40712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-a con 0x7fc5f40ae4d0 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5f40abe60 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f40ac860 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f413e500 con 0x7fc5f40abe60 2023-11-01T03:19:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.779+0000 7fc5fc290640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fc290640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40accd0 con 0x7fc5f40ae4d0 2023-11-01T03:19:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fc290640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fc290640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40ae8b0 con 0x7fc5f40ac860 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fc290640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fc290640 10 monclient(hunting): authenticate will time out at 1429.004313s 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fa82d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fa02c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc5f40ae4d0 0x7fc5f40712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.780+0000 7fc5fa82d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59408/0 (socket says 172.21.15.5:59408) 2023-11-01T03:19:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 1 -- 172.21.15.5:0/228282510 learned_addr learned my addr 172.21.15.5:0/228282510 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): get_auth_request con 0x7fc5f40ac860 auth_method 0 2023-11-01T03:19:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa02c640 10 monclient(hunting): get_auth_request con 0x7fc5f40ae4d0 auth_method 0 2023-11-01T03:19:12.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa02c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa02c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa02c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.781+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f210affd640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21040070e0 0x7f2104035e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 1 -- 172.21.15.5:0/2235450960 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794847216 0 0) 0x7f21040355f0 con 0x7f2104030b10 2023-11-01T03:19:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 10 monclient(hunting): _negotiate 2023-11-01T03:19:12.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 10 monclient(hunting): my global_id is 4345 2023-11-01T03:19:12.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f2109ffb640 1 -- 172.21.15.5:0/2235450960 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f4003520 con 0x7f2104030b10 2023-11-01T03:19:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f210affd640 10 monclient(hunting): get_auth_request con 0x7f21040070e0 auth_method 0 2023-11-01T03:19:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f210affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f210affd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7f210affd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7fc5fa02c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7fc5fa02c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.782+0000 7fc5fa02c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 10 monclient(hunting): handle_auth_done global_id 4348 payload 274 2023-11-01T03:19:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 1 -- 172.21.15.5:0/2235450960 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21040070e0 msgr2=0x7f2104035e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21040070e0 0x7f2104035e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 1 -- 172.21.15.5:0/2235450960 >> v1:172.21.15.153:6789/0 conn(0x7f2104030b10 legacy=0x7f2104033600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.783+0000 7f210b7fe640 1 -- 172.21.15.5:0/2235450960 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104035890 con 0x7f2104033d10 2023-11-01T03:19:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.784+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2023-11-01T03:19:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.784+0000 7fc5fa82d640 1 -- 172.21.15.5:0/228282510 >> v2:172.21.15.5:3300/0 conn(0x7fc5f40ae4d0 msgr2=0x7fc5f40712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.784+0000 7fc5fa82d640 1 --2- 172.21.15.5:0/228282510 >> v2:172.21.15.5:3300/0 conn(0x7fc5f40ae4d0 0x7fc5f40712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 1 -- 172.21.15.5:0/228282510 >> v1:172.21.15.5:6789/0 conn(0x7fc5f40abe60 legacy=0x7fc5f413ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.785+0000 7fc5fa82d640 1 -- 172.21.15.5:0/228282510 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40ac340 con 0x7fc5f40ac860 2023-11-01T03:19:12.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 1 -- 172.21.15.5:0/1926521703 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8034620 con 0x7fd30406dd60 2023-11-01T03:19:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: dump: 2023-11-01T03:19:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.815 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.816 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.817 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 1 -- 172.21.15.5:0/1926521703 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8034780 con 0x7fd30406dd60 2023-11-01T03:19:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd308f63640 5 monclient: authenticate success, global_id 4339 2023-11-01T03:19:12.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd308f63640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd308f63640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd308f63640 4 set_mon_vals no callback set 2023-11-01T03:19:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 1 -- 172.21.15.5:0/1926521703 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8034b50 con 0x7fd30406dd60 2023-11-01T03:19:12.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7fd3027fc640 10 monclient: dump: 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.822 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7fd308f63640 10 monclient: shutdown 2023-11-01T03:19:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7fd308f63640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7fd308f63640 1 -- 172.21.15.5:0/1926521703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30406dd60 msgr2=0x7fd30413a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7fd308f63640 1 --2- 172.21.15.5:0/1926521703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30406dd60 0x7fd30413a710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c840 tx=0x7fd2f802c290 comp rx=0 tx=0).stop 2023-11-01T03:19:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 -- 172.21.15.5:0/1926521703 shutdown_connections 2023-11-01T03:19:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 --2- 172.21.15.5:0/1926521703 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd30413ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 --2- 172.21.15.5:0/1926521703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd30406dd60 0x7fd30413a710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 -- 172.21.15.5:0/1926521703 >> 172.21.15.5:0/1926521703 conn(0x7fd3040b2ca0 msgr2=0x7fd3040b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7f6fa8cc9640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7f6fa8cc9640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.786+0000 7f6fa8cc9640 10 monclient: monmap: 2023-11-01T03:19:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.787383+0000 2023-11-01T03:19:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.787383+0000 2023-11-01T03:19:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.826 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.826 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7f6fa8cc9640 1 Processor -- start 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7f6fa8cc9640 1 -- start start 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.787+0000 7f6fa8cc9640 10 monclient: init 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2023-11-01T03:19:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6fa40a8c30 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fa40719e0 0x7f6fa40a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-a con 0x7f6fa40719e0 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa40ab610 0x7f6fa40aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-c con 0x7f6fa40ab610 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa40aac30 con 0x7f6fa40a8c30 2023-11-01T03:19:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40aaf10 con 0x7f6fa40719e0 2023-11-01T03:19:12.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40a9a60 con 0x7f6fa40ab610 2023-11-01T03:19:12.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7f6fa8cc9640 10 monclient(hunting): authenticate will time out at 1429.012746s 2023-11-01T03:19:12.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.789+0000 7f210b7fe640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f2104036360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f210c04faa0 tx=0x7f210c0a5990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77b65cf0ec81a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 -- 172.21.15.5:0/1926521703 shutdown_connections 2023-11-01T03:19:12.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.788+0000 7fd308f63640 1 -- 172.21.15.5:0/1926521703 wait complete. 2023-11-01T03:19:12.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.789+0000 7fc5fa82d640 1 --2- 172.21.15.5:0/228282510 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec02bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5014eb835a91b741 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.789+0000 7fd308f63640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.789+0000 7fd308f63640 10 monclient: monmap: 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.832 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.833 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.833 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.833 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.833 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f64082d0640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f64082d0640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f64082d0640 10 monclient: monmap: 2023-11-01T03:19:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.835 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.835 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.790958+0000 2023-11-01T03:19:12.835 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.790958+0000 2023-11-01T03:19:12.835 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.835 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.836 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f12bd397640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f12bd397640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f12bd397640 10 monclient: monmap: 2023-11-01T03:19:12.837 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.791173+0000 2023-11-01T03:19:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.791173+0000 2023-11-01T03:19:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.838 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.839 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 librados: starting msgr at 2023-11-01T03:19:12.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 librados: starting objecter 2023-11-01T03:19:12.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 Processor -- start 2023-11-01T03:19:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7faebca00640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7faebca00640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7faebca00640 10 monclient: monmap: 2023-11-01T03:19:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.841 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.791585+0000 2023-11-01T03:19:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.791585+0000 2023-11-01T03:19:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.842 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.843 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.843 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 -- start start 2023-11-01T03:19:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 librados: setting wanted keys 2023-11-01T03:19:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 1 librados: calling monclient init 2023-11-01T03:19:12.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7fd308f63640 10 monclient: init 2023-11-01T03:19:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.790+0000 7f64082d0640 1 Processor -- start 2023-11-01T03:19:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7f64082d0640 1 -- start start 2023-11-01T03:19:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7f64082d0640 10 monclient: init 2023-11-01T03:19:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7f12bd397640 1 Processor -- start 2023-11-01T03:19:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7f12bd397640 1 -- start start 2023-11-01T03:19:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7f12bd397640 10 monclient: init 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd30406dd60 0x7fd3041d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-a con 0x7fd30406dd60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd304133a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-c con 0x7fd30406eae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): picked mon.noname-b con 0x7fd304070890 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30413c790 con 0x7fd30406dd60 2023-11-01T03:19:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30413ca10 con 0x7fd304070890 2023-11-01T03:19:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30413f3e0 con 0x7fd30406eae0 2023-11-01T03:19:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7fd308f63640 10 monclient(hunting): authenticate will time out at 1429.015630s 2023-11-01T03:19:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7faebca00640 1 Processor -- start 2023-11-01T03:19:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2023-11-01T03:19:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f12b80a8ae0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b813f340 0x7f12b8145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-a con 0x7f12b813f340 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f12b80a8ec0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80a9600 con 0x7f12b80a8ec0 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b8145c50 con 0x7f12b80a8ae0 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b80a9360 con 0x7f12b813f340 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f12bd397640 10 monclient(hunting): authenticate will time out at 1429.016199s 2023-11-01T03:19:12.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2023-11-01T03:19:12.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f640006ffd0 0x7f64000ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-c con 0x7f640006ffd0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f64000af260 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-b con 0x7f64000703b0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6400071a60 con 0x7f64000af260 2023-11-01T03:19:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640006f910 con 0x7f640006ffd0 2023-11-01T03:19:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400071cd0 con 0x7f64000703b0 2023-11-01T03:19:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f64082d0640 10 monclient(hunting): authenticate will time out at 1429.016261s 2023-11-01T03:19:12.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa40ab610 0x7f6fa40aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fa40ab610 0x7f6fa40aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40804/0 (socket says 172.21.15.5:40804) 2023-11-01T03:19:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 1 -- 172.21.15.5:0/399608953 learned_addr learned my addr 172.21.15.5:0/399608953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 10 monclient(hunting): get_auth_request con 0x7f6fa40ab610 auth_method 0 2023-11-01T03:19:12.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7f6fa2d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7fd303fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7faebca00640 1 -- start start 2023-11-01T03:19:12.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.791+0000 7faebca00640 10 monclient: init 2023-11-01T03:19:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7faebca00640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7faebca00640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2023-11-01T03:19:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.792+0000 7faebca00640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): picked mon.noname-b con 0x7faeb806a040 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faeb80aab10 0x7faeb8149950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): picked mon.noname-a con 0x7faeb80aab10 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faeb80b04e0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80a8f50 con 0x7faeb80b04e0 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80aa1b0 con 0x7faeb80aab10 2023-11-01T03:19:12.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb806a420 con 0x7faeb806a040 2023-11-01T03:19:12.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7faebca00640 10 monclient(hunting): authenticate will time out at 1429.017285s 2023-11-01T03:19:12.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40810/0 (socket says 172.21.15.5:40810) 2023-11-01T03:19:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 1 -- 172.21.15.5:0/1668507347 learned_addr learned my addr 172.21.15.5:0/1668507347 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 10 monclient(hunting): get_auth_request con 0x7fd304070890 auth_method 0 2023-11-01T03:19:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd303fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fd3037fe640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd30406dd60 0x7fd3041d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7f6fa2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7f6fa2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7f6fa2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7f12b67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b813f340 0x7f12b8145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.793+0000 7fc5f902a640 1 -- 172.21.15.5:0/228282510 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec02c950 con 0x7fc5f40ac860 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 10 monclient: dump: 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.867 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5f902a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5fc290640 5 monclient: authenticate success, global_id 4280 2023-11-01T03:19:12.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fc5fc290640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fd303fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fd303fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7fd303fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b813f340 0x7f12b8145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52208/0 (socket says 172.21.15.5:52208) 2023-11-01T03:19:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 1 -- 172.21.15.5:0/2462173906 learned_addr learned my addr 172.21.15.5:0/2462173906 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 10 monclient(hunting): get_auth_request con 0x7f12b813f340 auth_method 0 2023-11-01T03:19:12.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.794+0000 7f12b67fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f12b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f12b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f12b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7fd3037fe640 10 monclient(hunting): get_auth_request con 0x7fd30406dd60 auth_method 0 2023-11-01T03:19:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7fd3037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7fd3037fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7fd3037fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f6fa2d9d640 10 monclient(hunting): handle_auth_done global_id 4351 payload 274 2023-11-01T03:19:12.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f6fa2d9d640 1 -- 172.21.15.5:0/399608953 >> v2:172.21.15.5:3300/0 conn(0x7f6fa40719e0 msgr2=0x7f6fa40a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f6fa2d9d640 1 --2- 172.21.15.5:0/399608953 >> v2:172.21.15.5:3300/0 conn(0x7f6fa40719e0 0x7f6fa40a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.795+0000 7f6fa2d9d640 1 -- 172.21.15.5:0/399608953 >> v1:172.21.15.153:6789/0 conn(0x7f6fa40a8c30 legacy=0x7f6fa40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.796+0000 7f6fa2d9d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.796+0000 7f6fa2d9d640 1 monclient: found mon.noname-c 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.796+0000 7f6fa2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.796+0000 7f6fa2d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.796+0000 7f6fa2d9d640 1 -- 172.21.15.5:0/399608953 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40aa0e0 con 0x7f6fa40ab610 2023-11-01T03:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f640686d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f640606c640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f640006ffd0 0x7f64000ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 1 -- 172.21.15.5:0/2235450960 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0aa700 con 0x7f2104033d10 2023-11-01T03:19:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: dump: 2023-11-01T03:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 1 -- 172.21.15.5:0/2235450960 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c0aa860 con 0x7f2104033d10 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 1 -- 172.21.15.5:0/2235450960 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0aac50 con 0x7f2104033d10 2023-11-01T03:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f2109ffb640 10 monclient: dump: 2023-11-01T03:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.883 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f210bfff640 5 monclient: authenticate success, global_id 4348 2023-11-01T03:19:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 1 -- 172.21.15.5:0/228282510 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec02cab0 con 0x7fc5f40ac860 2023-11-01T03:19:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f210bfff640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7f210bfff640 4 set_mon_vals no callback set 2023-11-01T03:19:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 1 -- 172.21.15.5:0/228282510 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec02ce40 con 0x7fc5f40ac860 2023-11-01T03:19:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5f902a640 10 monclient: dump: 2023-11-01T03:19:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.887 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5fc290640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.797+0000 7fc5fc290640 4 set_mon_vals no callback set 2023-11-01T03:19:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59426/0 (socket says 172.21.15.5:59426) 2023-11-01T03:19:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 1 -- 172.21.15.5:0/1437116662 learned_addr learned my addr 172.21.15.5:0/1437116662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): get_auth_request con 0x7f64000703b0 auth_method 0 2023-11-01T03:19:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 10 monclient: shutdown 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 -- 172.21.15.5:0/2235450960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 msgr2=0x7f2104036360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f2104036360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f210c04faa0 tx=0x7f210c0a5990 comp rx=0 tx=0).stop 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 -- 172.21.15.5:0/2235450960 shutdown_connections 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f2104036360 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 --2- 172.21.15.5:0/2235450960 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f21040070e0 0x7f2104035e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 -- 172.21.15.5:0/2235450960 >> 172.21.15.5:0/2235450960 conn(0x7f2104006030 msgr2=0x7f2104006440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 -- 172.21.15.5:0/2235450960 shutdown_connections 2023-11-01T03:19:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640606c640 10 monclient(hunting): get_auth_request con 0x7f640006ffd0 auth_method 0 2023-11-01T03:19:12.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640606c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640606c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640606c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7fc5fc290640 10 monclient: shutdown 2023-11-01T03:19:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7fc5fc290640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7fc5fc290640 1 -- 172.21.15.5:0/228282510 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 msgr2=0x7fc5f413b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7fc5fc290640 1 --2- 172.21.15.5:0/228282510 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009e50 tx=0x7fc5ec02bdb0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.798+0000 7f210bfff640 1 -- 172.21.15.5:0/2235450960 wait complete. 2023-11-01T03:19:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 -- 172.21.15.5:0/228282510 shutdown_connections 2023-11-01T03:19:12.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 --2- 172.21.15.5:0/228282510 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40ac860 0x7fc5f413b130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 --2- 172.21.15.5:0/228282510 >> v2:172.21.15.5:3300/0 conn(0x7fc5f40ae4d0 0x7fc5f40712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 -- 172.21.15.5:0/228282510 >> 172.21.15.5:0/228282510 conn(0x7fc5f40b2ff0 msgr2=0x7fc5f40b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 -- 172.21.15.5:0/228282510 shutdown_connections 2023-11-01T03:19:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7fc5fc290640 1 -- 172.21.15.5:0/228282510 wait complete. 2023-11-01T03:19:12.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 10 monclient(hunting): handle_auth_done global_id 4305 payload 274 2023-11-01T03:19:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 1 -- 172.21.15.5:0/2462173906 >> v1:172.21.15.153:6789/0 conn(0x7f12b80a8ae0 legacy=0x7f12b813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f210bfff640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f210bfff640 10 monclient: monmap: 2023-11-01T03:19:12.896 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.897 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 1 -- 172.21.15.5:0/2462173906 >> v1:172.21.15.5:6789/0 conn(0x7f12b80a8ec0 legacy=0x7f12b8145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 1 monclient: found mon.noname-a 2023-11-01T03:19:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:12.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f12b67fc640 1 -- 172.21.15.5:0/2462173906 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80b80b0 con 0x7f12b813f340 2023-11-01T03:19:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f210bfff640 1 librados: starting msgr at 2023-11-01T03:19:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.799+0000 7f210bfff640 1 librados: starting objecter 2023-11-01T03:19:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fd3037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fc5fc290640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fc5fc290640 10 monclient: monmap: 2023-11-01T03:19:12.901 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.902 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.903 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.903 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 Processor -- start 2023-11-01T03:19:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 -- start start 2023-11-01T03:19:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 librados: setting wanted keys 2023-11-01T03:19:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 librados: calling monclient init 2023-11-01T03:19:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 10 monclient: init 2023-11-01T03:19:12.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7faeaffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faeb80aab10 0x7faeb8149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fc5fc290640 1 librados: starting msgr at 2023-11-01T03:19:12.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7fc5fc290640 1 librados: starting objecter 2023-11-01T03:19:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:19:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21040070e0 0x7f21040c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f21040070e0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 0x7f21040c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f2104030b10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.800+0000 7f210bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f21041643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f2104033d10 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210402f940 con 0x7f21040070e0 2023-11-01T03:19:12.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040c8510 con 0x7f2104033d10 2023-11-01T03:19:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210402fe60 con 0x7f2104030b10 2023-11-01T03:19:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7f210bfff640 10 monclient(hunting): authenticate will time out at 1429.024992s 2023-11-01T03:19:12.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fc5fc290640 1 Processor -- start 2023-11-01T03:19:12.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fc5fc290640 1 -- start start 2023-11-01T03:19:12.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fc5fc290640 1 librados: setting wanted keys 2023-11-01T03:19:12.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fc5fc290640 1 librados: calling monclient init 2023-11-01T03:19:12.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fc5fc290640 10 monclient: init 2023-11-01T03:19:12.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 10 monclient(hunting): handle_auth_done global_id 4354 payload 824 2023-11-01T03:19:12.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 -- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 msgr2=0x7fd304133a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd304133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 -- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd30406dd60 msgr2=0x7fd3041d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd30406dd60 0x7fd3041d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.801+0000 7fd303fff640 1 -- 172.21.15.5:0/1668507347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f800c4a0 con 0x7fd304070890 2023-11-01T03:19:12.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 10 monclient(hunting): handle_auth_done global_id 4286 payload 274 2023-11-01T03:19:12.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 1 -- 172.21.15.5:0/1437116662 >> v2:172.21.15.153:3300/0 conn(0x7f640006ffd0 msgr2=0x7f64000ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 1 --2- 172.21.15.5:0/1437116662 >> v2:172.21.15.153:3300/0 conn(0x7f640006ffd0 0x7f64000ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 1 -- 172.21.15.5:0/1437116662 >> v1:172.21.15.153:6789/0 conn(0x7f64000af260 legacy=0x7f640013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7f640686d640 1 -- 172.21.15.5:0/1437116662 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400070b60 con 0x7f64000703b0 2023-11-01T03:19:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:19:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40abe60 0x7fc5f41c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-c con 0x7fc5f40abe60 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 0x7fc5f41408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-a con 0x7fc5f40ac860 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 0x7fc5f4141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.802+0000 7fc5fc290640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f40ae4d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4140e30 con 0x7fc5f40ac860 2023-11-01T03:19:12.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4138af0 con 0x7fc5f40ae4d0 2023-11-01T03:19:12.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f41410e0 con 0x7fc5f40abe60 2023-11-01T03:19:12.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.803+0000 7fc5fc290640 10 monclient(hunting): authenticate will time out at 1429.027446s 2023-11-01T03:19:12.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.804+0000 7f640686d640 1 --2- 172.21.15.5:0/1437116662 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e388305a77ec96 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7fd303fff640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c420 tx=0x7fd2f400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7fd2ebfff640 10 client.?.objecter ms_handle_connect 0x7fd304070890 2023-11-01T03:19:12.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7fd2ebfff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:12.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7ff89259e640 10 monclient: get_monmap_and_config 2023-11-01T03:19:12.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7ff89259e640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.805+0000 7ff89259e640 10 monclient: monmap: 2023-11-01T03:19:12.920 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:12.806645+0000 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:12.806645+0000 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.921 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:12.922 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:12.922 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7f12b67fc640 1 --2- 172.21.15.5:0/2462173906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b813f340 0x7f12b8145000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009e50 tx=0x7f12a802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f0fdab0b799293 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7ff89259e640 1 Processor -- start 2023-11-01T03:19:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7ff89259e640 1 -- start start 2023-11-01T03:19:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7ff89259e640 10 monclient: init 2023-11-01T03:19:12.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59428/0 (socket says 172.21.15.5:59428) 2023-11-01T03:19:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 1 -- 172.21.15.5:0/3623431799 learned_addr learned my addr 172.21.15.5:0/3623431799 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 10 monclient(hunting): get_auth_request con 0x7faeb806a040 auth_method 0 2023-11-01T03:19:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7faeb659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.806+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f21041643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeaffff640 10 monclient(hunting): get_auth_request con 0x7faeb80aab10 auth_method 0 2023-11-01T03:19:12.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeaffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeaffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeb659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeb659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7faeb659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c0b4240 0x7ff88c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-b con 0x7ff88c0b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff88c0b38d0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff88c0ade00 0x7ff88c13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-a con 0x7ff88c0ade00 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88c0b0cc0 con 0x7ff88c0b38d0 2023-11-01T03:19:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88c0b4620 con 0x7ff88c0ade00 2023-11-01T03:19:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0b1690 con 0x7ff88c0b4240 2023-11-01T03:19:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.807+0000 7ff89259e640 10 monclient(hunting): authenticate will time out at 1429.031456s 2023-11-01T03:19:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.808+0000 7f6fa2d9d640 1 --2- 172.21.15.5:0/399608953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40ab610 0x7f6fa40aba30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4071e10 tx=0x7f6f9402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740120f41c3221c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.808+0000 7faeb659c640 10 monclient(hunting): handle_auth_done global_id 4289 payload 274 2023-11-01T03:19:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 1 -- 172.21.15.5:0/3623431799 >> v2:172.21.15.5:3300/0 conn(0x7faeb80aab10 msgr2=0x7faeb8149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 1 --2- 172.21.15.5:0/3623431799 >> v2:172.21.15.5:3300/0 conn(0x7faeb80aab10 0x7faeb8149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 1 -- 172.21.15.5:0/3623431799 >> v1:172.21.15.5:6789/0 conn(0x7faeb80b04e0 legacy=0x7faeb80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 10 monclient: _finish_hunting 0 2023-11-01T03:19:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 1 monclient: found mon.noname-b 2023-11-01T03:19:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.809+0000 7faeb659c640 1 -- 172.21.15.5:0/3623431799 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80a9230 con 0x7faeb806a040 2023-11-01T03:19:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f21041643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40828/0 (socket says 172.21.15.5:40828) 2023-11-01T03:19:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 1 -- 172.21.15.5:0/3372274737 learned_addr learned my addr 172.21.15.5:0/3372274737 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 10 monclient(hunting): get_auth_request con 0x7f2104033d10 auth_method 0 2023-11-01T03:19:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.810+0000 7fc5fa82d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 0x7fc5f4141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 1 -- 172.21.15.5:0/1437116662 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00317c0 con 0x7f64000703b0 2023-11-01T03:19:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 10 monclient: dump: 2023-11-01T03:19:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f640506a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f64082d0640 5 monclient: authenticate success, global_id 4286 2023-11-01T03:19:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.811+0000 7f64082d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7faeb659c640 1 --2- 172.21.15.5:0/3623431799 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95f2261041b027f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 0x7fc5f4141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40838/0 (socket says 172.21.15.5:40838) 2023-11-01T03:19:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 1 -- 172.21.15.5:0/1641612898 learned_addr learned my addr 172.21.15.5:0/1641612898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 10 monclient(hunting): get_auth_request con 0x7fc5f40ae4d0 auth_method 0 2023-11-01T03:19:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.812+0000 7fc5fa82d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 1 -- 172.21.15.5:0/1437116662 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0031920 con 0x7f64000703b0 2023-11-01T03:19:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 1 -- 172.21.15.5:0/1437116662 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0031cb0 con 0x7f64000703b0 2023-11-01T03:19:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.814+0000 7f640506a640 10 monclient: dump: 2023-11-01T03:19:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.943 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 4 set_mon_vals no callback set 2023-11-01T03:19:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7fc5fa82d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 10 monclient: shutdown 2023-11-01T03:19:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 -- 172.21.15.5:0/1437116662 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 msgr2=0x7f640013fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 --2- 172.21.15.5:0/1437116662 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f002b860 comp rx=0 tx=0).stop 2023-11-01T03:19:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 -- 172.21.15.5:0/1437116662 shutdown_connections 2023-11-01T03:19:12.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 --2- 172.21.15.5:0/1437116662 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000703b0 0x7f640013fe60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 --2- 172.21.15.5:0/1437116662 >> v2:172.21.15.153:3300/0 conn(0x7f640006ffd0 0x7f64000ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f64082d0640 1 -- 172.21.15.5:0/1437116662 >> 172.21.15.5:0/1437116662 conn(0x7f64000665e0 msgr2=0x7f64000b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.815+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f64082d0640 1 -- 172.21.15.5:0/1437116662 shutdown_connections 2023-11-01T03:19:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f64082d0640 1 -- 172.21.15.5:0/1437116662 wait complete. 2023-11-01T03:19:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 1 -- 172.21.15.5:0/399608953 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940317e0 con 0x7f6fa40ab610 2023-11-01T03:19:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: dump: 2023-11-01T03:19:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 1 -- 172.21.15.5:0/399608953 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94031940 con 0x7f6fa40ab610 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa159a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa8cc9640 5 monclient: authenticate success, global_id 4351 2023-11-01T03:19:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa8cc9640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.816+0000 7f6fa8cc9640 4 set_mon_vals no callback set 2023-11-01T03:19:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 10 monclient: shutdown 2023-11-01T03:19:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/399608953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40ab610 msgr2=0x7f6fa40aba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/399608953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40ab610 0x7f6fa40aba30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4071e10 tx=0x7f6f9402b880 comp rx=0 tx=0).stop 2023-11-01T03:19:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 10 monclient: monmap: 2023-11-01T03:19:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.956 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/399608953 shutdown_connections 2023-11-01T03:19:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/399608953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40ab610 0x7f6fa40aba30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/399608953 >> v2:172.21.15.5:3300/0 conn(0x7f6fa40719e0 0x7f6fa40a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/399608953 >> 172.21.15.5:0/399608953 conn(0x7f6fa40b2e10 msgr2=0x7f6fa40b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/399608953 shutdown_connections 2023-11-01T03:19:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/399608953 wait complete. 2023-11-01T03:19:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 librados: starting msgr at 2023-11-01T03:19:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 librados: starting objecter 2023-11-01T03:19:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 Processor -- start 2023-11-01T03:19:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 1 -- 172.21.15.5:0/2462173906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a802c9f0 con 0x7f12b813f340 2023-11-01T03:19:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 10 monclient: dump: 2023-11-01T03:19:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7fc5f982b640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 0x7fc5f41408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f12b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 1 -- 172.21.15.5:0/2462173906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a802cb50 con 0x7f12b813f340 2023-11-01T03:19:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 10 monclient: monmap: 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.965 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 1 -- 172.21.15.5:0/2462173906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80343f0 con 0x7f12b813f340 2023-11-01T03:19:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 5 monclient: authenticate success, global_id 4305 2023-11-01T03:19:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 4 set_mon_vals no callback set 2023-11-01T03:19:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12b5ffb640 10 monclient: dump: 2023-11-01T03:19:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.969 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 -- start start 2023-11-01T03:19:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 librados: setting wanted keys 2023-11-01T03:19:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 1 librados: calling monclient init 2023-11-01T03:19:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.817+0000 7f64082d0640 10 monclient: init 2023-11-01T03:19:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 librados: starting msgr at 2023-11-01T03:19:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 librados: starting objecter 2023-11-01T03:19:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 Processor -- start 2023-11-01T03:19:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7fc5f982b640 10 monclient(hunting): get_auth_request con 0x7fc5f40ac860 auth_method 0 2023-11-01T03:19:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7fc5f982b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7fc5f982b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7fc5f982b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 -- start start 2023-11-01T03:19:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 librados: setting wanted keys 2023-11-01T03:19:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 1 librados: calling monclient init 2023-11-01T03:19:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f6fa8cc9640 10 monclient: init 2023-11-01T03:19:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f640006ffd0 0x7f6400135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-b con 0x7f640006ffd0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64000703b0 0x7f6400135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-a con 0x7f64000703b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f64082d0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 10 monclient: shutdown 2023-11-01T03:19:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 1 -- 172.21.15.5:0/2462173906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b813f340 msgr2=0x7f12b8145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.818+0000 7f12bd397640 1 --2- 172.21.15.5:0/2462173906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b813f340 0x7f12b8145000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009e50 tx=0x7f12a802be50 comp rx=0 tx=0).stop 2023-11-01T03:19:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:19:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40719e0 0x7f6fa41ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-b con 0x7f6fa40719e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): picked mon.noname-c con 0x7f64000af260 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-c con 0x7f6fa40a8c30 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa40ab610 0x7f6fa4151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): picked mon.noname-a con 0x7f6fa40ab610 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:12.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64001373c0 con 0x7f64000703b0 2023-11-01T03:19:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41ef1e0 con 0x7f6fa40ab610 2023-11-01T03:19:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4084c40 con 0x7f6fa40719e0 2023-11-01T03:19:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4084db0 con 0x7f6fa40a8c30 2023-11-01T03:19:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f6fa8cc9640 10 monclient(hunting): authenticate will time out at 1429.043093s 2023-11-01T03:19:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640014e010 con 0x7f640006ffd0 2023-11-01T03:19:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f12bd397640 1 -- 172.21.15.5:0/2462173906 shutdown_connections 2023-11-01T03:19:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000ab8b0 con 0x7f64000af260 2023-11-01T03:19:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f12bd397640 1 --2- 172.21.15.5:0/2462173906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b813f340 0x7f12b8145000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f12bd397640 1 -- 172.21.15.5:0/2462173906 >> 172.21.15.5:0/2462173906 conn(0x7f12b80b7230 msgr2=0x7f12b80b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f64082d0640 10 monclient(hunting): authenticate will time out at 1429.043208s 2023-11-01T03:19:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fc5f982b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fc5f982b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fc5f982b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40052d0 con 0x7fd304070890 2023-11-01T03:19:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: dump: 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: _finish_auth 0 2023-11-01T03:19:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4005430 con 0x7fd304070890 2023-11-01T03:19:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4007260 con 0x7fd304070890 2023-11-01T03:19:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f12bd397640 1 -- 172.21.15.5:0/2462173906 shutdown_connections 2023-11-01T03:19:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7f12bd397640 1 -- 172.21.15.5:0/2462173906 wait complete. 2023-11-01T03:19:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd2ebfff640 10 monclient: dump: 2023-11-01T03:19:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:12.989 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:12.991 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 5 monclient: authenticate success, global_id 4354 2023-11-01T03:19:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 10 monclient: _renew_subs 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041344f0 con 0x7fd304070890 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd3017fa640 4 set_mon_vals no callback set 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 10 monclient: _renew_subs 2023-11-01T03:19:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30413b7a0 con 0x7fd304070890 2023-11-01T03:19:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7fd308f63640 1 librados: init done 2023-11-01T03:19:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.819+0000 7ff88b7fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff88c0b38d0 0x7ff88c0ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:55592/0 (socket says 172.21.15.5:55592) 2023-11-01T03:19:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7ff88b7fe640 1 -- 172.21.15.5:0/3987558842 learned_addr learned my addr 172.21.15.5:0/3987558842 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 10 monclient: build_initial_monmap 2023-11-01T03:19:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 10 monclient: monmap: 2023-11-01T03:19:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:12.996 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 librados: starting msgr at 2023-11-01T03:19:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 librados: starting objecter 2023-11-01T03:19:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7fd308f63640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7fd308f63640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7fd308f63640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30413d5f0 con 0x7fd304070890 2023-11-01T03:19:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 Processor -- start 2023-11-01T03:19:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 -- start start 2023-11-01T03:19:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 librados: setting wanted keys 2023-11-01T03:19:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 1 librados: calling monclient init 2023-11-01T03:19:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f12bd397640 10 monclient: init 2023-11-01T03:19:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.820+0000 7f210a7fc640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 0x7f21040c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80a8ae0 0x7f12b8134c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-a con 0x7f12b80a8ae0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12b80a8ec0 0x7f12b8129b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-b con 0x7f12b80a8ec0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): picked mon.noname-c con 0x7f12b813f340 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8130110 con 0x7f12b80a8ae0 2023-11-01T03:19:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b81351c0 con 0x7f12b80a8ec0 2023-11-01T03:19:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8135380 con 0x7f12b813f340 2023-11-01T03:19:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f12bd397640 10 monclient(hunting): authenticate will time out at 1429.045310s 2023-11-01T03:19:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f210a7fc640 10 monclient(hunting): get_auth_request con 0x7f2104030b10 auth_method 0 2023-11-01T03:19:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f210a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f210a7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7f210a7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.821+0000 7fc5fa02c640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40abe60 0x7fc5f41c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7f210a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7f210a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7f210a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7fc5fa02c640 10 monclient(hunting): get_auth_request con 0x7fc5f40abe60 auth_method 0 2023-11-01T03:19:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7fc5fa02c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7fc5fa02c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.822+0000 7fc5fa02c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 10 monclient(hunting): handle_auth_done global_id 4314 payload 824 2023-11-01T03:19:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 -- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40abe60 msgr2=0x7fc5f41c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40abe60 0x7fc5f41c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 -- 172.21.15.5:0/1641612898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 msgr2=0x7fc5f4141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 0x7fc5f4141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 monclient: found mon.noname-a 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.824+0000 7fc5f982b640 1 -- 172.21.15.5:0/1641612898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009b30 con 0x7fc5f40ac860 2023-11-01T03:19:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 10 monclient(hunting): handle_auth_done global_id 4292 payload 824 2023-11-01T03:19:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 -- 172.21.15.5:0/3372274737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 msgr2=0x7f21041643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f21041643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 -- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21040070e0 msgr2=0x7f21040c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21040070e0 0x7f21040c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 monclient: found mon.noname-c 2023-11-01T03:19:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.825+0000 7f210a7fc640 1 -- 172.21.15.5:0/3372274737 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c068fc0 con 0x7f2104030b10 2023-11-01T03:19:13.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.828+0000 7f6fa1d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.828+0000 7fc5f982b640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 0x7fc5f41408f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40ac270 tx=0x7fc5f000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.828+0000 7fc5eaffd640 10 client.?.objecter ms_handle_connect 0x7fc5f40ac860 2023-11-01T03:19:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.828+0000 7fc5eaffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.829+0000 7ff890b3b640 1 --2- 172.21.15.5:0/3987558842 >> v2:172.21.15.5:3300/0 conn(0x7ff88c0ade00 0x7ff88c13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 1 -- 172.21.15.5:0/3623431799 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80317c0 con 0x7faeb806a040 2023-11-01T03:19:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: dump: 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.014 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 1 -- 172.21.15.5:0/3623431799 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8031920 con 0x7faeb806a040 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faebca00640 5 monclient: authenticate success, global_id 4289 2023-11-01T03:19:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faebca00640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faebca00640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 1 -- 172.21.15.5:0/3623431799 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8031cb0 con 0x7faeb806a040 2023-11-01T03:19:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faebca00640 4 set_mon_vals no callback set 2023-11-01T03:19:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7faeb5d9b640 10 monclient: dump: 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.019 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f210a7fc640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 0x7f21040c78c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c430 tx=0x7f20fc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f20f37fe640 10 client.?.objecter ms_handle_connect 0x7f2104030b10 2023-11-01T03:19:13.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f20f37fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59480/0 (socket says 172.21.15.5:59480) 2023-11-01T03:19:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 1 -- 172.21.15.5:0/322021528 learned_addr learned my addr 172.21.15.5:0/322021528 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 10 monclient(hunting): get_auth_request con 0x7f6fa40a8c30 auth_method 0 2023-11-01T03:19:13.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 10 monclient: shutdown 2023-11-01T03:19:13.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 -- 172.21.15.5:0/3623431799 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 msgr2=0x7faeb8149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 --2- 172.21.15.5:0/3623431799 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802b860 comp rx=0 tx=0).stop 2023-11-01T03:19:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.830+0000 7f6fa1d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 -- 172.21.15.5:0/3623431799 shutdown_connections 2023-11-01T03:19:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 --2- 172.21.15.5:0/3623431799 >> v2:172.21.15.5:3300/0 conn(0x7faeb80aab10 0x7faeb8149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 --2- 172.21.15.5:0/3623431799 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb806a040 0x7faeb8149410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 -- 172.21.15.5:0/3623431799 >> 172.21.15.5:0/3623431799 conn(0x7faeb80b0b90 msgr2=0x7faeb80b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 -- 172.21.15.5:0/3623431799 shutdown_connections 2023-11-01T03:19:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7faebca00640 1 -- 172.21.15.5:0/3623431799 wait complete. 2023-11-01T03:19:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7ff88bfff640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c0b4240 0x7ff88c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7ff890b3b640 10 monclient(hunting): get_auth_request con 0x7ff88c0ade00 auth_method 0 2023-11-01T03:19:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7ff890b3b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7ff890b3b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.831+0000 7ff890b3b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 10 monclient: build_initial_monmap 2023-11-01T03:19:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 10 monclient: monmap: 2023-11-01T03:19:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:13.029 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 librados: starting msgr at 2023-11-01T03:19:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 librados: starting objecter 2023-11-01T03:19:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7f6fa1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7f6fa1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7f6fa1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 Processor -- start 2023-11-01T03:19:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 -- start start 2023-11-01T03:19:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 librados: setting wanted keys 2023-11-01T03:19:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 1 librados: calling monclient init 2023-11-01T03:19:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.832+0000 7faebca00640 10 monclient: init 2023-11-01T03:19:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:19:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb806a040 0x7faeb8140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): picked mon.noname-a con 0x7faeb806a040 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb80aab10 0x7faeb81ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): picked mon.noname-c con 0x7faeb80aab10 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): picked mon.noname-b con 0x7faeb80b04e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8146d40 con 0x7faeb806a040 2023-11-01T03:19:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81de440 con 0x7faeb80b04e0 2023-11-01T03:19:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80ade20 con 0x7faeb80aab10 2023-11-01T03:19:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7faebca00640 10 monclient(hunting): authenticate will time out at 1429.057352s 2023-11-01T03:19:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7ff890b3b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7ff890b3b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7ff890b3b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0004220 con 0x7fc5f40ac860 2023-11-01T03:19:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: dump: 2023-11-01T03:19:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f0004380 con 0x7fc5f40ac860 2023-11-01T03:19:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.833+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000f8e0 con 0x7fc5f40ac860 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5eaffd640 10 monclient: dump: 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 5 monclient: authenticate success, global_id 4314 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5f8829640 4 set_mon_vals no callback set 2023-11-01T03:19:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 10 monclient: _renew_subs 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f41ca130 con 0x7fc5f40ac860 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 10 client.4314.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 10 monclient: _renew_subs 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f41d5c60 con 0x7fc5f40ac860 2023-11-01T03:19:13.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7fc5fc290640 1 librados: init done 2023-11-01T03:19:13.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7ff88bfff640 10 monclient(hunting): get_auth_request con 0x7ff88c0b4240 auth_method 0 2023-11-01T03:19:13.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7ff88bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7ff88bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.834+0000 7ff88bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.835+0000 7fc5fc290640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.835+0000 7fc5fc290640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.835+0000 7fc5fc290640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.835+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f404e9f0 con 0x7fc5f40ac860 2023-11-01T03:19:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 10 monclient(hunting): handle_auth_done global_id 4317 payload 274 2023-11-01T03:19:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 1 -- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c0b4240 msgr2=0x7ff88c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c0b4240 0x7ff88c0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 1 -- 172.21.15.5:0/3987558842 >> v1:172.21.15.153:6789/0 conn(0x7ff88c0b38d0 legacy=0x7ff88c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 1 monclient: found mon.noname-a 2023-11-01T03:19:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.836+0000 7ff890b3b640 1 -- 172.21.15.5:0/3987558842 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c13f5f0 con 0x7ff88c0ade00 2023-11-01T03:19:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 10 monclient(hunting): handle_auth_done global_id 4298 payload 824 2023-11-01T03:19:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 -- 172.21.15.5:0/322021528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40719e0 msgr2=0x7f6fa41ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40719e0 0x7f6fa41ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 -- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa40ab610 msgr2=0x7f6fa4151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa40ab610 0x7f6fa4151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 monclient: found mon.noname-c 2023-11-01T03:19:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.837+0000 7f6fa1d9b640 1 -- 172.21.15.5:0/322021528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940094d0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.840+0000 7f12b77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.841+0000 7f640686d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59492/0 (socket says 172.21.15.5:59492) 2023-11-01T03:19:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 1 -- 172.21.15.5:0/497518096 learned_addr learned my addr 172.21.15.5:0/497518096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 10 monclient(hunting): get_auth_request con 0x7f12b813f340 auth_method 0 2023-11-01T03:19:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f12b77fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.842+0000 7f640686d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59464/0 (socket says 172.21.15.5:59464) 2023-11-01T03:19:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f640686d640 1 -- 172.21.15.5:0/4104163418 learned_addr learned my addr 172.21.15.5:0/4104163418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f640686d640 10 monclient(hunting): get_auth_request con 0x7f64000af260 auth_method 0 2023-11-01T03:19:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f640686d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f640686d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f640686d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f6fa1d9b640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00ba50 tx=0x7f6f9c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f6f92ffd640 10 client.?.objecter ms_handle_connect 0x7f6fa40a8c30 2023-11-01T03:19:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f6f92ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f12b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f12b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.843+0000 7f12b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd2f40073c0 con 0x7fd304070890 2023-11-01T03:19:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7fd2ebfff640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 0x7fd2f006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7f640686d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7fd3037fe640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 0x7fd2f006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.844+0000 7fd3037fe640 10 monclient: get_auth_request con 0x7fd2f006c850 auth_method 0 2023-11-01T03:19:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.845+0000 7fd3037fe640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 0x7fd2f006ed10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8034000 tx=0x7fd2f802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.845+0000 7fd2ebfff640 10 client.4354.objecter ms_handle_connect 0x7fd2f006c850 2023-11-01T03:19:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc005ce0 con 0x7f2104030b10 2023-11-01T03:19:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: dump: 2023-11-01T03:19:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 5 monclient: authenticate success, global_id 4292 2023-11-01T03:19:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 10 monclient: _renew_subs 2023-11-01T03:19:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210402f560 con 0x7f2104030b10 2023-11-01T03:19:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc005e40 con 0x7f2104030b10 2023-11-01T03:19:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0072d0 con 0x7f2104030b10 2023-11-01T03:19:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 10 client.4292.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f20f37fe640 10 monclient: dump: 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.071 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 10 monclient: _renew_subs 2023-11-01T03:19:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104164b00 con 0x7f2104030b10 2023-11-01T03:19:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f210bfff640 1 librados: init done 2023-11-01T03:19:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.846+0000 7f21097fa640 4 set_mon_vals no callback set 2023-11-01T03:19:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.847+0000 7f210bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.847+0000 7f210bfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.847+0000 7f210bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.847+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104164cf0 con 0x7f2104030b10 2023-11-01T03:19:13.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 10 monclient(hunting): handle_auth_done global_id 4304 payload 824 2023-11-01T03:19:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 -- 172.21.15.5:0/497518096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12b80a8ec0 msgr2=0x7f12b8129b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12b80a8ec0 0x7f12b8129b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 -- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80a8ae0 msgr2=0x7f12b8134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80a8ae0 0x7f12b8134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 monclient: found mon.noname-c 2023-11-01T03:19:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.849+0000 7f12b77fe640 1 -- 172.21.15.5:0/497518096 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009b30 con 0x7f12b813f340 2023-11-01T03:19:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00cbe0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 10 monclient: dump: 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6f92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 5 monclient: authenticate success, global_id 4298 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 10 monclient: _renew_subs 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa40acb80 con 0x7f6fa40a8c30 2023-11-01T03:19:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 10 client.4298.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 10 monclient: _renew_subs 2023-11-01T03:19:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa40829b0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.851+0000 7f6fa8cc9640 1 librados: init done 2023-11-01T03:19:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.852+0000 7f6fa8cc9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.852+0000 7f6fa8cc9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.852+0000 7f6fa8cc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.852+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa41ef040 con 0x7f6fa40a8c30 2023-11-01T03:19:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 10 monclient(hunting): handle_auth_done global_id 4307 payload 824 2023-11-01T03:19:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 -- 172.21.15.5:0/4104163418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f640006ffd0 msgr2=0x7f6400135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f640006ffd0 0x7f6400135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 -- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64000703b0 msgr2=0x7f6400135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64000703b0 0x7f6400135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 monclient: found mon.noname-c 2023-11-01T03:19:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.855+0000 7f640686d640 1 -- 172.21.15.5:0/4104163418 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00094d0 con 0x7f64000af260 2023-11-01T03:19:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c009930 con 0x7f6fa40a8c30 2023-11-01T03:19:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c01e440 con 0x7f6fa40a8c30 2023-11-01T03:19:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6f92ffd640 10 monclient: dump: 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.085 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.086 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.856+0000 7f6fa0d99640 4 set_mon_vals no callback set 2023-11-01T03:19:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.858+0000 7f640686d640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63f002b8a0 tx=0x7f63f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.858+0000 7f63f6ffd640 10 client.?.objecter ms_handle_connect 0x7f64000af260 2023-11-01T03:19:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.858+0000 7f63f6ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0032860 con 0x7f64000af260 2023-11-01T03:19:13.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: dump: 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.090 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.091 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.092 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00329e0 con 0x7f64000af260 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0032d90 con 0x7f64000af260 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f63f6ffd640 10 monclient: dump: 2023-11-01T03:19:13.093 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.094 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.094 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.094 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.094 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.094 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 5 monclient: authenticate success, global_id 4307 2023-11-01T03:19:13.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f6404869640 4 set_mon_vals no callback set 2023-11-01T03:19:13.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 10 monclient: _renew_subs 2023-11-01T03:19:13.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640014dca0 con 0x7f64000af260 2023-11-01T03:19:13.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 10 client.4307.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 10 monclient: _renew_subs 2023-11-01T03:19:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000aa470 con 0x7f64000af260 2023-11-01T03:19:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.863+0000 7f64082d0640 1 librados: init done 2023-11-01T03:19:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.864+0000 7f64082d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.865+0000 7f64082d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.865+0000 7f64082d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:12.865+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000a9a70 con 0x7f64000af260 2023-11-01T03:19:13.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.074+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd2f4007670 con 0x7fd304070890 2023-11-01T03:19:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.074+0000 7fd2ebfff640 10 client.4354.objecter ms_dispatch 0x7fd304000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.074+0000 7fd2ebfff640 3 client.4354.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.074+0000 7fd2ebfff640 3 client.4354.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.074+0000 7fd2ebfff640 20 client.4354.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.084+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2f4054160 con 0x7fd304070890 2023-11-01T03:19:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.084+0000 7fd2ebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.084+0000 7fd2ebfff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.086+0000 7faeb6d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40862/0 (socket says 172.21.15.5:40862) 2023-11-01T03:19:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 1 -- 172.21.15.5:0/3009681041 learned_addr learned my addr 172.21.15.5:0/3009681041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 10 monclient(hunting): get_auth_request con 0x7faeb80b04e0 auth_method 0 2023-11-01T03:19:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.087+0000 7faeb6d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.088+0000 7faeb6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.088+0000 7faeb6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.088+0000 7faeb6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 10 monclient(hunting): handle_auth_done global_id 4366 payload 824 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 -- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb80aab10 msgr2=0x7faeb81ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb80aab10 0x7faeb81ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 -- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb806a040 msgr2=0x7faeb8140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb806a040 0x7faeb8140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 monclient: found mon.noname-b 2023-11-01T03:19:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.092+0000 7faeb6d9d640 1 -- 172.21.15.5:0/3009681041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80094d0 con 0x7faeb80b04e0 2023-11-01T03:19:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.095+0000 7faeb6d9d640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faeb000b930 tx=0x7faeb000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.095+0000 7faeaeffd640 10 client.?.objecter ms_handle_connect 0x7faeb80b04e0 2023-11-01T03:19:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.095+0000 7faeaeffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.098+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000cb20 con 0x7faeb80b04e0 2023-11-01T03:19:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: dump: 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000ccc0 con 0x7faeb80b04e0 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0014680 con 0x7faeb80b04e0 2023-11-01T03:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeaeffd640 10 monclient: dump: 2023-11-01T03:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 5 monclient: authenticate success, global_id 4366 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 10 monclient: _renew_subs 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faeb559a640 4 set_mon_vals no callback set 2023-11-01T03:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80ae0a0 con 0x7faeb80b04e0 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 10 monclient: _renew_subs 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb81daa70 con 0x7faeb80b04e0 2023-11-01T03:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.099+0000 7faebca00640 1 librados: init done 2023-11-01T03:19:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.100+0000 7faebca00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.100+0000 7faebca00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.100+0000 7faebca00640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.100+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb804e9f0 con 0x7faeb80b04e0 2023-11-01T03:19:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.104+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc5f000fa40 con 0x7fc5f40ac860 2023-11-01T03:19:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.104+0000 7fc5eaffd640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 0x7fc5d80730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.104+0000 7fc5fa02c640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 0x7fc5d80730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.104+0000 7fc5fa02c640 10 monclient: get_auth_request con 0x7fc5d8070c10 auth_method 0 2023-11-01T03:19:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.105+0000 7fc5eaffd640 10 client.4314.objecter ms_handle_connect 0x7fc5d8070c10 2023-11-01T03:19:13.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.105+0000 7fc5fa02c640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 0x7fc5d80730d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400abd0 tx=0x7fc5e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc5f0058dd0 con 0x7fc5f40ac860 2023-11-01T03:19:13.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 10 client.4314.objecter ms_dispatch 0x7fc5f4000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 3 client.4314.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 3 client.4314.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 20 client.4314.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7ff890b3b640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c13b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0097a0 tx=0x7ff87c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd656ff767a177a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5f0054a10 con 0x7fc5f40ac860 2023-11-01T03:19:13.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.120+0000 7fc5eaffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 1 -- 172.21.15.5:0/3987558842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c02f050 con 0x7ff88c0ade00 2023-11-01T03:19:13.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: dump: 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.135 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.136 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.136 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 1 -- 172.21.15.5:0/3987558842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c031700 con 0x7ff88c0ade00 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff89259e640 5 monclient: authenticate success, global_id 4317 2023-11-01T03:19:13.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff89259e640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff89259e640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 1 -- 172.21.15.5:0/3987558842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c031a90 con 0x7ff88c0ade00 2023-11-01T03:19:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff89259e640 4 set_mon_vals no callback set 2023-11-01T03:19:13.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.133+0000 7ff88affd640 10 monclient: dump: 2023-11-01T03:19:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.139 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.140 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.140 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.140 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.140 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.140 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.141 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.141 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 10 monclient: shutdown 2023-11-01T03:19:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 -- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 msgr2=0x7ff88c13b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c13b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0097a0 tx=0x7ff87c02b7a0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 -- 172.21.15.5:0/3987558842 shutdown_connections 2023-11-01T03:19:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c13b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 --2- 172.21.15.5:0/3987558842 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c0b4240 0x7ff88c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 -- 172.21.15.5:0/3987558842 >> 172.21.15.5:0/3987558842 conn(0x7ff88c065cd0 msgr2=0x7ff88c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 -- 172.21.15.5:0/3987558842 shutdown_connections 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 1 -- 172.21.15.5:0/3987558842 wait complete. 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 10 monclient: build_initial_monmap 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.134+0000 7ff89259e640 10 monclient: monmap: 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 librados: starting msgr at 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 librados: starting objecter 2023-11-01T03:19:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 Processor -- start 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 -- start start 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 librados: setting wanted keys 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 1 librados: calling monclient init 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.135+0000 7ff89259e640 10 monclient: init 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:19:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-a con 0x7ff88c0ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff88c0b4240 0x7ff88c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-b con 0x7ff88c0b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c13d080 0x7ff88c0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): picked mon.noname-c con 0x7ff88c13d080 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c13ed00 con 0x7ff88c0ade00 2023-11-01T03:19:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c1d6790 con 0x7ff88c0b4240 2023-11-01T03:19:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c0a87a0 con 0x7ff88c13d080 2023-11-01T03:19:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.136+0000 7ff89259e640 10 monclient(hunting): authenticate will time out at 1429.360253s 2023-11-01T03:19:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.139+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52296/0 (socket says 172.21.15.5:52296) 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 1 -- 172.21.15.5:0/626692291 learned_addr learned my addr 172.21.15.5:0/626692291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): get_auth_request con 0x7ff88c0ade00 auth_method 0 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.140+0000 7ff88bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2023-11-01T03:19:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 -- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c13d080 msgr2=0x7ff88c0a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c13d080 0x7ff88c0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 -- 172.21.15.5:0/626692291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff88c0b4240 msgr2=0x7ff88c0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff88c0b4240 0x7ff88c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 monclient: found mon.noname-a 2023-11-01T03:19:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.145+0000 7ff88bfff640 1 -- 172.21.15.5:0/626692291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c009400 con 0x7ff88c0ade00 2023-11-01T03:19:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.149+0000 7ff88bfff640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff884007e40 tx=0x7ff88400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.149+0000 7ff888ff9640 10 client.?.objecter ms_handle_connect 0x7ff88c0ade00 2023-11-01T03:19:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.149+0000 7ff888ff9640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884014620 con 0x7ff88c0ade00 2023-11-01T03:19:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: dump: 2023-11-01T03:19:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff884014780 con 0x7ff88c0ade00 2023-11-01T03:19:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff89259e640 5 monclient: authenticate success, global_id 4320 2023-11-01T03:19:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff89259e640 10 monclient: _renew_subs 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff89259e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c1d71f0 con 0x7ff88c0ade00 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff888ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff88a7fc640 4 set_mon_vals no callback set 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.155+0000 7ff89259e640 10 client.4320.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff89259e640 10 monclient: _renew_subs 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884014b10 con 0x7ff88c0ade00 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff89259e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c139730 con 0x7ff88c0ade00 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff89259e640 1 librados: init done 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff888ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff888ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.156+0000 7ff888ff9640 10 monclient: dump: 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.157+0000 7ff89259e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.157+0000 7ff89259e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.157+0000 7ff89259e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.157+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c1d6950 con 0x7ff88c0ade00 2023-11-01T03:19:13.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.271+0000 7fd308f63640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:13.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.271+0000 7fd308f63640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:13.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.271+0000 7fd308f63640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.271+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd30413ba80 con 0x7fd304070890 2023-11-01T03:19:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.310+0000 7fc5fc290640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.310+0000 7fc5fc290640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.310+0000 7fc5fc290640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.310+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc5f4142260 con 0x7fc5f40ac860 2023-11-01T03:19:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.341+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faeb00147e0 con 0x7faeb80b04e0 2023-11-01T03:19:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.342+0000 7faeaeffd640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 0x7fae9806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.342+0000 7faeb659c640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 0x7fae9806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.342+0000 7faeb659c640 10 monclient: get_auth_request con 0x7fae9806c850 auth_method 0 2023-11-01T03:19:13.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.342+0000 7faeaeffd640 10 client.4366.objecter ms_handle_connect 0x7fae9806c850 2023-11-01T03:19:13.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.342+0000 7faeb659c640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 0x7fae9806ed10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.348+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faeb000ce30 con 0x7faeb80b04e0 2023-11-01T03:19:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.348+0000 7faeaeffd640 10 client.4366.objecter ms_dispatch 0x7faeb8000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.348+0000 7faeaeffd640 3 client.4366.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.348+0000 7faeaeffd640 3 client.4366.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.348+0000 7faeaeffd640 20 client.4366.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.363+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faeb0054dc0 con 0x7faeb80b04e0 2023-11-01T03:19:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.363+0000 7faeaeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.363+0000 7faeaeffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.364+0000 7fd2ebfff640 1 -- 172.21.15.5:0/1668507347 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2f4020090 con 0x7fd304070890 2023-11-01T03:19:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.364+0000 7fd2ebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.364+0000 7fd2ebfff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:13.366 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-01T03:19:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 10 librados: watch_flush enter 2023-11-01T03:19:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 10 librados: watch_flush exit 2023-11-01T03:19:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 20 client.4354.objecter shutdown clearing up homeless session... 2023-11-01T03:19:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 10 client.4354.objecter successfully canceled tick 2023-11-01T03:19:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 msgr2=0x7fd2f006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 0x7fd2f006ed10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8034000 tx=0x7fd2f802f000 comp rx=0 tx=0).stop 2023-11-01T03:19:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 10 monclient: shutdown 2023-11-01T03:19:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 msgr2=0x7fd304133fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c420 tx=0x7fd2f400c8e0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 shutdown_connections 2023-11-01T03:19:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fd2f006c850 0x7fd2f006ed10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd304070890 0x7fd304133fb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fd30406eae0 0x7fd304133a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 --2- 172.21.15.5:0/1668507347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd30406dd60 0x7fd3041d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 >> 172.21.15.5:0/1668507347 conn(0x7fd3040b2ca0 msgr2=0x7fd3040b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 shutdown_connections 2023-11-01T03:19:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 -- 172.21.15.5:0/1668507347 wait complete. 2023-11-01T03:19:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.366+0000 7fd308f63640 1 librados: shutdown 2023-11-01T03:19:13.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-01T03:19:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.392+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f20fc007430 con 0x7f2104030b10 2023-11-01T03:19:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.392+0000 7f20f37fe640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 0x7f20f806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.392+0000 7f210affd640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 0x7f20f806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.393+0000 7f210affd640 10 monclient: get_auth_request con 0x7f20f806c800 auth_method 0 2023-11-01T03:19:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.393+0000 7f20f37fe640 10 client.4292.objecter ms_handle_connect 0x7f20f806c800 2023-11-01T03:19:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.393+0000 7f210affd640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 0x7f20f806ecc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21000098f0 tx=0x7f2100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.445+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff884014c70 con 0x7ff88c0ade00 2023-11-01T03:19:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.446+0000 7ff888ff9640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 0x7ff87806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.446+0000 7ff88b7fe640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 0x7ff87806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.446+0000 7ff88b7fe640 10 monclient: get_auth_request con 0x7ff87806c850 auth_method 0 2023-11-01T03:19:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.446+0000 7ff88b7fe640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 0x7ff87806ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff880007fd0 tx=0x7ff880007aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.446+0000 7ff888ff9640 10 client.4320.objecter ms_handle_connect 0x7ff87806c850 2023-11-01T03:19:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff88400ee30 con 0x7ff88c0ade00 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 10 client.4320.objecter ms_dispatch 0x7ff88c000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 3 client.4320.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 3 client.4320.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 20 client.4320.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.459+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff884055e90 con 0x7ff88c0ade00 2023-11-01T03:19:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.460+0000 7ff888ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.460+0000 7ff888ff9640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.517+0000 7fc5eaffd640 1 -- 172.21.15.5:0/1641612898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5f0058030 con 0x7fc5f40ac860 2023-11-01T03:19:13.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.517+0000 7fc5eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:13.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.517+0000 7fc5eaffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:13.519 INFO:teuthology.orchestra.run.smithi005.stdout:64424509445 2023-11-01T03:19:13.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 10 librados: watch_flush enter 2023-11-01T03:19:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 10 librados: watch_flush exit 2023-11-01T03:19:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 20 client.4314.objecter shutdown clearing up homeless session... 2023-11-01T03:19:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 10 client.4314.objecter successfully canceled tick 2023-11-01T03:19:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 msgr2=0x7fc5d80730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 0x7fc5d80730d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400abd0 tx=0x7fc5e4008040 comp rx=0 tx=0).stop 2023-11-01T03:19:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 10 monclient: shutdown 2023-11-01T03:19:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 msgr2=0x7fc5f41408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 0x7fc5f41408f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40ac270 tx=0x7fc5f000b870 comp rx=0 tx=0).stop 2023-11-01T03:19:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 shutdown_connections 2023-11-01T03:19:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc5d8070c10 0x7fc5d80730d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5f40ae4d0 0x7fc5f4141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5f40ac860 0x7fc5f41408f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 --2- 172.21.15.5:0/1641612898 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc5f40abe60 0x7fc5f41c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 >> 172.21.15.5:0/1641612898 conn(0x7fc5f40b2ff0 msgr2=0x7fc5f4073690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 shutdown_connections 2023-11-01T03:19:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 -- 172.21.15.5:0/1641612898 wait complete. 2023-11-01T03:19:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.520+0000 7fc5fc290640 1 librados: shutdown 2023-11-01T03:19:13.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-11-01T03:19:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.576+0000 7faebca00640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.576+0000 7faebca00640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.576+0000 7faebca00640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.576+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faeb80a86e0 con 0x7faeb80b04e0 2023-11-01T03:19:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.580+0000 7faeaeffd640 1 -- 172.21.15.5:0/3009681041 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faeb0019090 con 0x7faeb80b04e0 2023-11-01T03:19:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.580+0000 7faeaeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.580+0000 7faeaeffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:13.581 INFO:teuthology.orchestra.run.smithi005.stdout:73014444035 2023-11-01T03:19:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 10 librados: watch_flush enter 2023-11-01T03:19:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 10 librados: watch_flush exit 2023-11-01T03:19:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 20 client.4366.objecter shutdown clearing up homeless session... 2023-11-01T03:19:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 10 client.4366.objecter successfully canceled tick 2023-11-01T03:19:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 msgr2=0x7fae9806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 0x7fae9806ed10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea8030000 comp rx=0 tx=0).stop 2023-11-01T03:19:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 10 monclient: shutdown 2023-11-01T03:19:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 msgr2=0x7faeb81de8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faeb000b930 tx=0x7faeb000bdf0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 shutdown_connections 2023-11-01T03:19:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fae9806c850 0x7fae9806ed10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb80b04e0 0x7faeb81de8d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7faeb80aab10 0x7faeb81ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 --2- 172.21.15.5:0/3009681041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb806a040 0x7faeb8140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.582+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 >> 172.21.15.5:0/3009681041 conn(0x7faeb80b0b90 msgr2=0x7faeb806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.583+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 shutdown_connections 2023-11-01T03:19:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.583+0000 7faebca00640 1 -- 172.21.15.5:0/3009681041 wait complete. 2023-11-01T03:19:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.583+0000 7faebca00640 1 librados: shutdown 2023-11-01T03:19:13.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444035 for osd.2 2023-11-01T03:19:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.652+0000 7ff89259e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.652+0000 7ff89259e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.652+0000 7ff89259e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.652+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff88c1d65f0 con 0x7ff88c0ade00 2023-11-01T03:19:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.656+0000 7ff888ff9640 1 -- 172.21.15.5:0/626692291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff88c1d65f0 con 0x7ff88c0ade00 2023-11-01T03:19:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.656+0000 7ff888ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:13.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.656+0000 7ff888ff9640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:13.658 INFO:teuthology.orchestra.run.smithi005.stdout:68719476739 2023-11-01T03:19:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 10 librados: watch_flush enter 2023-11-01T03:19:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 10 librados: watch_flush exit 2023-11-01T03:19:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 20 client.4320.objecter shutdown clearing up homeless session... 2023-11-01T03:19:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 10 client.4320.objecter successfully canceled tick 2023-11-01T03:19:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 msgr2=0x7ff87806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 0x7ff87806ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff880007fd0 tx=0x7ff880007aa0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 10 monclient: shutdown 2023-11-01T03:19:13.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 msgr2=0x7ff88c1d6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff884007e40 tx=0x7ff88400e4b0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 shutdown_connections 2023-11-01T03:19:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff87806c850 0x7ff87806ed10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff88c13d080 0x7ff88c0a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff88c0b4240 0x7ff88c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 --2- 172.21.15.5:0/626692291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c0ade00 0x7ff88c1d6cb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 >> 172.21.15.5:0/626692291 conn(0x7ff88c065cd0 msgr2=0x7ff88c0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 shutdown_connections 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 -- 172.21.15.5:0/626692291 wait complete. 2023-11-01T03:19:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.659+0000 7ff89259e640 1 librados: shutdown 2023-11-01T03:19:13.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476739 for osd.1 2023-11-01T03:19:13.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.677+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f9c01d3b0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.677+0000 7f6f92ffd640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 0x7f6f8406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.677+0000 7f6fa259c640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 0x7f6f8406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.677+0000 7f6fa259c640 10 monclient: get_auth_request con 0x7f6f8406c800 auth_method 0 2023-11-01T03:19:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.678+0000 7f6f92ffd640 10 client.4298.objecter ms_handle_connect 0x7f6f8406c800 2023-11-01T03:19:13.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.678+0000 7f6fa259c640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 0x7f6f8406ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f98001560 tx=0x7f6f98007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6f9c0586d0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 10 client.4298.objecter ms_dispatch 0x7f6fa4000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 3 client.4298.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 3 client.4298.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 20 client.4298.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f9c0584a0 con 0x7f6fa40a8c30 2023-11-01T03:19:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f6f92ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f12b77fe640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c360 tx=0x7f12b000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f129f7fe640 10 client.?.objecter ms_handle_connect 0x7f12b813f340 2023-11-01T03:19:13.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.691+0000 7f129f7fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.704+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f20fc057e80 con 0x7f2104030b10 2023-11-01T03:19:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.704+0000 7f20f37fe640 10 client.4292.objecter ms_dispatch 0x7f210c000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.704+0000 7f20f37fe640 3 client.4292.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.704+0000 7f20f37fe640 3 client.4292.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.705+0000 7f20f37fe640 20 client.4292.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.705+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20fc0541c0 con 0x7f2104030b10 2023-11-01T03:19:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.705+0000 7f20f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.705+0000 7f20f37fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.720+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63f00453f0 con 0x7f64000af260 2023-11-01T03:19:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.720+0000 7f63f6ffd640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 0x7f63e406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.720+0000 7f640606c640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 0x7f63e406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.720+0000 7f640606c640 10 monclient: get_auth_request con 0x7f63e406c800 auth_method 0 2023-11-01T03:19:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.721+0000 7f63f6ffd640 10 client.4307.objecter ms_handle_connect 0x7f63e406c800 2023-11-01T03:19:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.721+0000 7f640606c640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 0x7f63e406ecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63f80070b0 tx=0x7f63f8007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63f007b3c0 con 0x7f64000af260 2023-11-01T03:19:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 10 client.4307.objecter ms_dispatch 0x7f6400000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 3 client.4307.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 3 client.4307.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 20 client.4307.objecter dump_active .. 0 homeless 2023-11-01T03:19:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63f0077000 con 0x7f64000af260 2023-11-01T03:19:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.736+0000 7f63f6ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00035f0 con 0x7f12b813f340 2023-11-01T03:19:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: dump: 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.770 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.770 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.770 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.770 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.771 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.771 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:13.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:13.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 5 monclient: authenticate success, global_id 4304 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 10 monclient: _renew_subs 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b8133600 con 0x7f12b813f340 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 10 client.4304.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 10 monclient: _renew_subs 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b812a7f0 con 0x7f12b813f340 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12bd397640 1 librados: init done 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b0003770 con 0x7f12b813f340 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f12b57fa640 4 set_mon_vals no callback set 2023-11-01T03:19:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0003b20 con 0x7f12b813f340 2023-11-01T03:19:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.767+0000 7f129f7fe640 10 monclient: dump: 2023-11-01T03:19:13.774 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:13.776 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.768+0000 7f12bd397640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.768+0000 7f12bd397640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.768+0000 7f12bd397640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.768+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b804e9f0 con 0x7f12b813f340 2023-11-01T03:19:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.893+0000 7f210bfff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-01T03:19:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.893+0000 7f210bfff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-01T03:19:13.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.893+0000 7f210bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.893+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f21040056b0 con 0x7f2104030b10 2023-11-01T03:19:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.895+0000 7f6fa8cc9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:13.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.895+0000 7f6fa8cc9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.895+0000 7f6fa8cc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.895+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fa41ef040 con 0x7f6fa40a8c30 2023-11-01T03:19:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.928+0000 7f64082d0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-01T03:19:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.928+0000 7f64082d0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-01T03:19:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.928+0000 7f64082d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:13.928+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f64000a9a70 con 0x7f64000af260 2023-11-01T03:19:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.051+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f12b0003c80 con 0x7f12b813f340 2023-11-01T03:19:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.052+0000 7f129f7fe640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 0x7f12a406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.052+0000 7f12b6ffd640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 0x7f12a406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.052+0000 7f12b6ffd640 10 monclient: get_auth_request con 0x7f12a406c800 auth_method 0 2023-11-01T03:19:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.052+0000 7f129f7fe640 10 client.4304.objecter ms_handle_connect 0x7f12a406c800 2023-11-01T03:19:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.052+0000 7f12b6ffd640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 0x7f12a406ecc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001550 tx=0x7f12ac007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f12b0058510 con 0x7f12b813f340 2023-11-01T03:19:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 10 client.4304.objecter ms_dispatch 0x7f12b8000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 3 client.4304.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 3 client.4304.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 20 client.4304.objecter dump_active .. 0 homeless 2023-11-01T03:19:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12b0054150 con 0x7f12b813f340 2023-11-01T03:19:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.065+0000 7f129f7fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.077+0000 7f6f92ffd640 1 -- 172.21.15.5:0/322021528 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fa41ef040 con 0x7f6fa40a8c30 2023-11-01T03:19:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.077+0000 7f6f92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.077+0000 7f6f92ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:14.078 INFO:teuthology.orchestra.run.smithi005.stdout:68719476740 2023-11-01T03:19:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 10 librados: watch_flush enter 2023-11-01T03:19:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 10 librados: watch_flush exit 2023-11-01T03:19:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 20 client.4298.objecter shutdown clearing up homeless session... 2023-11-01T03:19:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 10 client.4298.objecter successfully canceled tick 2023-11-01T03:19:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 msgr2=0x7f6f8406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 0x7f6f8406ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f98001560 tx=0x7f6f98007990 comp rx=0 tx=0).stop 2023-11-01T03:19:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 10 monclient: shutdown 2023-11-01T03:19:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 msgr2=0x7f6fa41510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00ba50 tx=0x7f6f9c00bf10 comp rx=0 tx=0).stop 2023-11-01T03:19:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 shutdown_connections 2023-11-01T03:19:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f6f8406c800 0x7f6f8406ecc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa40ab610 0x7f6fa4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f6fa40a8c30 0x7f6fa41510f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 --2- 172.21.15.5:0/322021528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fa40719e0 0x7f6fa41ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 >> 172.21.15.5:0/322021528 conn(0x7f6fa40b2e10 msgr2=0x7f6fa40aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 shutdown_connections 2023-11-01T03:19:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 -- 172.21.15.5:0/322021528 wait complete. 2023-11-01T03:19:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.079+0000 7f6fa8cc9640 1 librados: shutdown 2023-11-01T03:19:14.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.3 2023-11-01T03:19:14.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.147+0000 7f20f37fe640 1 -- 172.21.15.5:0/3372274737 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20fc021090 con 0x7f2104030b10 2023-11-01T03:19:14.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.147+0000 7f20f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-01T03:19:14.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.147+0000 7f20f37fe640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:14.149 INFO:teuthology.orchestra.run.smithi005.stdout:60129542149 2023-11-01T03:19:14.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.148+0000 7f63f6ffd640 1 -- 172.21.15.5:0/4104163418 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64000a9a70 con 0x7f64000af260 2023-11-01T03:19:14.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.148+0000 7f63f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-01T03:19:14.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.148+0000 7f63f6ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:14.150 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-11-01T03:19:14.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 10 librados: watch_flush enter 2023-11-01T03:19:14.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 10 librados: watch_flush exit 2023-11-01T03:19:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 20 client.4292.objecter shutdown clearing up homeless session... 2023-11-01T03:19:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 10 client.4292.objecter successfully canceled tick 2023-11-01T03:19:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 msgr2=0x7f20f806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 0x7f20f806ecc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f21000098f0 tx=0x7f2100008040 comp rx=0 tx=0).stop 2023-11-01T03:19:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 10 monclient: shutdown 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 msgr2=0x7f21040c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.149+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 0x7f21040c78c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c430 tx=0x7f20fc00c8f0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 shutdown_connections 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f20f806c800 0x7f20f806ecc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2104033d10 0x7f21041643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2104030b10 0x7f21040c78c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 --2- 172.21.15.5:0/3372274737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21040070e0 0x7f21040c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 >> 172.21.15.5:0/3372274737 conn(0x7f2104006030 msgr2=0x7f2104034e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 10 librados: watch_flush enter 2023-11-01T03:19:14.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 10 librados: watch_flush exit 2023-11-01T03:19:14.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 20 client.4307.objecter shutdown clearing up homeless session... 2023-11-01T03:19:14.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 10 client.4307.objecter successfully canceled tick 2023-11-01T03:19:14.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 shutdown_connections 2023-11-01T03:19:14.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 msgr2=0x7f63e406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 -- 172.21.15.5:0/3372274737 wait complete. 2023-11-01T03:19:14.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f210bfff640 1 librados: shutdown 2023-11-01T03:19:14.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 0x7f63e406ecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63f80070b0 tx=0x7f63f8007040 comp rx=0 tx=0).stop 2023-11-01T03:19:14.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 10 monclient: shutdown 2023-11-01T03:19:14.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 msgr2=0x7f64000a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63f002b8a0 tx=0x7f63f00046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 shutdown_connections 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f63e406c800 0x7f63e406ecc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f64000af260 0x7f64000a9d50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64000703b0 0x7f6400135ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 --2- 172.21.15.5:0/4104163418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f640006ffd0 0x7f6400135990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 >> 172.21.15.5:0/4104163418 conn(0x7f64000665e0 msgr2=0x7f640006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 shutdown_connections 2023-11-01T03:19:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 -- 172.21.15.5:0/4104163418 wait complete. 2023-11-01T03:19:14.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.150+0000 7f64082d0640 1 librados: shutdown 2023-11-01T03:19:14.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2023-11-01T03:19:14.164 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:14.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2023-11-01T03:19:14.165 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.258+0000 7f12bd397640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-01T03:19:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.258+0000 7f12bd397640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-01T03:19:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.258+0000 7f12bd397640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.258+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12b80b3110 con 0x7f12b813f340 2023-11-01T03:19:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.266+0000 7f129f7fe640 1 -- 172.21.15.5:0/497518096 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12b0017090 con 0x7f12b813f340 2023-11-01T03:19:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.266+0000 7f129f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-01T03:19:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.266+0000 7f129f7fe640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:14.267 INFO:teuthology.orchestra.run.smithi005.stdout:68719476742 2023-11-01T03:19:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.267+0000 7f12bd397640 10 librados: watch_flush enter 2023-11-01T03:19:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.267+0000 7f12bd397640 10 librados: watch_flush exit 2023-11-01T03:19:14.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.267+0000 7f12bd397640 20 client.4304.objecter shutdown clearing up homeless session... 2023-11-01T03:19:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.267+0000 7f12bd397640 10 client.4304.objecter successfully canceled tick 2023-11-01T03:19:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 msgr2=0x7f12a406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 0x7f12a406ecc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12ac001550 tx=0x7f12ac007990 comp rx=0 tx=0).stop 2023-11-01T03:19:14.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 10 monclient: shutdown 2023-11-01T03:19:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 msgr2=0x7f12b812a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c360 tx=0x7f12b000c820 comp rx=0 tx=0).stop 2023-11-01T03:19:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 shutdown_connections 2023-11-01T03:19:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f12a406c800 0x7f12a406ecc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f12b813f340 0x7f12b812a0d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12b80a8ec0 0x7f12b8129b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 --2- 172.21.15.5:0/497518096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80a8ae0 0x7f12b8134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 >> 172.21.15.5:0/497518096 conn(0x7f12b80b7230 msgr2=0x7f12b80b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 shutdown_connections 2023-11-01T03:19:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 -- 172.21.15.5:0/497518096 wait complete. 2023-11-01T03:19:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.268+0000 7f12bd397640 1 librados: shutdown 2023-11-01T03:19:14.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2023-11-01T03:19:14.279 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:14.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-01T03:19:14.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 10 monclient: get_monmap_and_config 2023-11-01T03:19:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 10 monclient: monmap: 2023-11-01T03:19:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.487 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:14.486103+0000 2023-11-01T03:19:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:14.486103+0000 2023-11-01T03:19:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:14.488 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 1 Processor -- start 2023-11-01T03:19:14.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 1 -- start start 2023-11-01T03:19:14.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.485+0000 7fbe10a56640 10 monclient: init 2023-11-01T03:19:14.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2023-11-01T03:19:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbe0c0ae4d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:14.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe0c0abe60 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbe0c13b840 0x7fbe0c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-c con 0x7fbe0c13b840 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c13e500 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c0ac340 con 0x7fbe0c0abe60 2023-11-01T03:19:14.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0ad040 con 0x7fbe0c13b840 2023-11-01T03:19:14.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.486+0000 7fbe10a56640 10 monclient(hunting): authenticate will time out at 1430.710626s 2023-11-01T03:19:14.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe0c0ae4d0 0x7fbe0c13ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56904/0 (socket says 172.21.15.5:56904) 2023-11-01T03:19:14.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0a59c640 1 -- 172.21.15.5:0/757464823 learned_addr learned my addr 172.21.15.5:0/757464823 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:14.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0ad9d640 1 --2- 172.21.15.5:0/757464823 >> v2:172.21.15.153:3300/0 conn(0x7fbe0c13b840 0x7fbe0c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0ad9d640 10 monclient(hunting): get_auth_request con 0x7fbe0c13b840 auth_method 0 2023-11-01T03:19:14.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.487+0000 7fbe0ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.488+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.488+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.488+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 1 -- 172.21.15.5:0/757464823 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461383902 0 0) 0x7fbe0c13e500 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 10 monclient(hunting): _negotiate 2023-11-01T03:19:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 10 monclient(hunting): my global_id is 4323 2023-11-01T03:19:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.489+0000 7fbe0959a640 1 -- 172.21.15.5:0/757464823 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf8003520 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_done global_id 4369 payload 274 2023-11-01T03:19:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 1 -- 172.21.15.5:0/757464823 >> v1:172.21.15.153:6789/0 conn(0x7fbe0c0abe60 legacy=0x7fbe0c13b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 1 -- 172.21.15.5:0/757464823 >> v1:172.21.15.5:6789/0 conn(0x7fbe0c0ae4d0 legacy=0x7fbe0c13ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 1 monclient: found mon.noname-c 2023-11-01T03:19:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.490+0000 7fbe0ad9d640 1 -- 172.21.15.5:0/757464823 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0ad180 con 0x7fbe0c13b840 2023-11-01T03:19:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.495+0000 7fbe0ad9d640 1 --2- 172.21.15.5:0/757464823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c13b840 0x7fbe0c0712c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00a940 tx=0x7fbdfc02cd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9821527d070b31a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 1 -- 172.21.15.5:0/757464823 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc02dab0 con 0x7fbe0c13b840 2023-11-01T03:19:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: dump: 2023-11-01T03:19:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.506 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.506 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.506 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.506 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.506 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 1 -- 172.21.15.5:0/757464823 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc02dc10 con 0x7fbe0c13b840 2023-11-01T03:19:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 1 -- 172.21.15.5:0/757464823 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc035440 con 0x7fbe0c13b840 2023-11-01T03:19:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe10a56640 5 monclient: authenticate success, global_id 4369 2023-11-01T03:19:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe10a56640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe10a56640 4 set_mon_vals no callback set 2023-11-01T03:19:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.498+0000 7fbe0959a640 10 monclient: dump: 2023-11-01T03:19:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.511 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 10 monclient: shutdown 2023-11-01T03:19:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 -- 172.21.15.5:0/757464823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c13b840 msgr2=0x7fbe0c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 --2- 172.21.15.5:0/757464823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c13b840 0x7fbe0c0712c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00a940 tx=0x7fbdfc02cd00 comp rx=0 tx=0).stop 2023-11-01T03:19:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 -- 172.21.15.5:0/757464823 shutdown_connections 2023-11-01T03:19:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 --2- 172.21.15.5:0/757464823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c13b840 0x7fbe0c0712c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 -- 172.21.15.5:0/757464823 >> 172.21.15.5:0/757464823 conn(0x7fbe0c0b2ff0 msgr2=0x7fbe0c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 -- 172.21.15.5:0/757464823 shutdown_connections 2023-11-01T03:19:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.499+0000 7fbe10a56640 1 -- 172.21.15.5:0/757464823 wait complete. 2023-11-01T03:19:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 10 monclient: monmap: 2023-11-01T03:19:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.513 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:14.515 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:14.515 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:14.515 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 librados: starting msgr at 2023-11-01T03:19:14.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 librados: starting objecter 2023-11-01T03:19:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 Processor -- start 2023-11-01T03:19:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 -- start start 2023-11-01T03:19:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 librados: setting wanted keys 2023-11-01T03:19:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 1 librados: calling monclient init 2023-11-01T03:19:14.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.500+0000 7fbe10a56640 10 monclient: init 2023-11-01T03:19:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:19:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0abe60 0x7fbe0c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-a con 0x7fbe0c0abe60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-b con 0x7fbe0c0ae4d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:14.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe0c13b840 0x7fbe0c1d99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): picked mon.noname-c con 0x7fbe0c13b840 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c070040 con 0x7fbe0c0abe60 2023-11-01T03:19:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1d6ca0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1d6980 con 0x7fbe0c13b840 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.501+0000 7fbe10a56640 10 monclient(hunting): authenticate will time out at 1430.725464s 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0abe60 0x7fbe0c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe0c13b840 0x7fbe0c1d99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40880/0 (socket says 172.21.15.5:40880) 2023-11-01T03:19:14.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 1 -- 172.21.15.5:0/2988658582 learned_addr learned my addr 172.21.15.5:0/2988658582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:14.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): get_auth_request con 0x7fbe0c0ae4d0 auth_method 0 2023-11-01T03:19:14.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0a59c640 10 monclient(hunting): get_auth_request con 0x7fbe0c0abe60 auth_method 0 2023-11-01T03:19:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0a59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0ad9d640 10 monclient(hunting): get_auth_request con 0x7fbe0c13b840 auth_method 0 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe0ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.502+0000 7fbe09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.503+0000 7fbe0ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 10 monclient(hunting): handle_auth_done global_id 4375 payload 824 2023-11-01T03:19:14.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 -- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe0c13b840 msgr2=0x7fbe0c1d99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe0c13b840 0x7fbe0c1d99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 -- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0abe60 msgr2=0x7fbe0c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0abe60 0x7fbe0c070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 monclient: found mon.noname-b 2023-11-01T03:19:14.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.505+0000 7fbe09d9b640 1 -- 172.21.15.5:0/2988658582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc00a5a0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.507+0000 7fbe09d9b640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c400 tx=0x7fbdf400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.507+0000 7fbe02ffd640 10 client.?.objecter ms_handle_connect 0x7fbe0c0ae4d0 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.507+0000 7fbe02ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.510+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40052d0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.510+0000 7fbe02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.510+0000 7fbe02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.510+0000 7fbe02ffd640 10 monclient: dump: 2023-11-01T03:19:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.531 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4005430 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 5 monclient: authenticate success, global_id 4375 2023-11-01T03:19:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 monclient: _renew_subs 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c1421c0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4003830 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe02ffd640 10 monclient: dump: 2023-11-01T03:19:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe08d99640 4 set_mon_vals no callback set 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 client.4375.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 monclient: _renew_subs 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c1d73a0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 1 librados: init done 2023-11-01T03:19:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.511+0000 7fbe10a56640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.512+0000 7fbe10a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.512+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c1d6eb0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-01T03:19:14.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-01T03:19:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.644+0000 7f3c5c6a2640 10 monclient: get_monmap_and_config 2023-11-01T03:19:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.644+0000 7f3c5c6a2640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.644+0000 7f3c5c6a2640 10 monclient: monmap: 2023-11-01T03:19:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:14.645737+0000 2023-11-01T03:19:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:14.645737+0000 2023-11-01T03:19:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:14.648 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.645+0000 7f3c5c6a2640 1 Processor -- start 2023-11-01T03:19:14.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.645+0000 7f3c5c6a2640 1 -- start start 2023-11-01T03:19:14.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.645+0000 7f3c5c6a2640 10 monclient: init 2023-11-01T03:19:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2023-11-01T03:19:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 0x7f3c540b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-b con 0x7f3c540b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3c540b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c540ade00 0x7f3c5413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-a con 0x7f3c540ade00 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540b0cc0 con 0x7f3c540b38d0 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540b4620 con 0x7f3c540ade00 2023-11-01T03:19:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540b1690 con 0x7f3c540b4240 2023-11-01T03:19:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.646+0000 7f3c5c6a2640 10 monclient(hunting): authenticate will time out at 1430.870324s 2023-11-01T03:19:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5a43e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 0x7f3c540b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5ac3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c540ade00 0x7f3c5413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c59c3d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c540b38d0 0x7f3c540ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56918/0 (socket says 172.21.15.5:56918) 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c59c3d640 1 -- 172.21.15.5:0/1623724731 learned_addr learned my addr 172.21.15.5:0/1623724731 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5a43e640 10 monclient(hunting): get_auth_request con 0x7f3c540b4240 auth_method 0 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5a43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5a43e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5a43e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5ac3f640 10 monclient(hunting): get_auth_request con 0x7f3c540ade00 auth_method 0 2023-11-01T03:19:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5ac3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5ac3f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.647+0000 7f3c5ac3f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5ac3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5ac3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.648+0000 7f3c5ac3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_done global_id 4313 payload 274 2023-11-01T03:19:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 1 -- 172.21.15.5:0/1623724731 >> v2:172.21.15.5:3300/0 conn(0x7f3c540ade00 msgr2=0x7f3c5413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 1 --2- 172.21.15.5:0/1623724731 >> v2:172.21.15.5:3300/0 conn(0x7f3c540ade00 0x7f3c5413b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 1 -- 172.21.15.5:0/1623724731 >> v1:172.21.15.5:6789/0 conn(0x7f3c540b38d0 legacy=0x7f3c540ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 1 monclient: found mon.noname-b 2023-11-01T03:19:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.650+0000 7f3c5a43e640 1 -- 172.21.15.5:0/1623724731 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5413f5f0 con 0x7f3c540b4240 2023-11-01T03:19:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.653+0000 7f3c5a43e640 1 --2- 172.21.15.5:0/1623724731 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 0x7f3c540b1150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c500097a0 tx=0x7f3c5002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b128ab7d85858db0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 1 -- 172.21.15.5:0/1623724731 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5002e070 con 0x7f3c540b4240 2023-11-01T03:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: dump: 2023-11-01T03:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 1 -- 172.21.15.5:0/1623724731 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c500315a0 con 0x7f3c540b4240 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 1 -- 172.21.15.5:0/1623724731 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50031930 con 0x7f3c540b4240 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5c6a2640 5 monclient: authenticate success, global_id 4313 2023-11-01T03:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5c6a2640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5c6a2640 4 set_mon_vals no callback set 2023-11-01T03:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.657+0000 7f3c5943c640 10 monclient: dump: 2023-11-01T03:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 10 monclient: shutdown 2023-11-01T03:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/1623724731 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 msgr2=0x7f3c540b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/1623724731 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 0x7f3c540b1150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c500097a0 tx=0x7f3c5002b840 comp rx=0 tx=0).stop 2023-11-01T03:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/1623724731 shutdown_connections 2023-11-01T03:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/1623724731 >> v2:172.21.15.5:3300/0 conn(0x7f3c540ade00 0x7f3c5413b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/1623724731 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540b4240 0x7f3c540b1150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.658+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/1623724731 >> 172.21.15.5:0/1623724731 conn(0x7f3c54065cd0 msgr2=0x7f3c540660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/1623724731 shutdown_connections 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/1623724731 wait complete. 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 10 monclient: monmap: 2023-11-01T03:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 1 librados: starting msgr at 2023-11-01T03:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.659+0000 7f3c5c6a2640 1 librados: starting objecter 2023-11-01T03:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 Processor -- start 2023-11-01T03:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 -- start start 2023-11-01T03:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 librados: setting wanted keys 2023-11-01T03:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 librados: calling monclient init 2023-11-01T03:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient: init 2023-11-01T03:19:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:19:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-c con 0x7f3c540ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c540b4240 0x7f3c540a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-a con 0x7f3c540b4240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c54143d10 0x7f3c540a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): picked mon.noname-b con 0x7f3c54143d10 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541d9ec0 con 0x7f3c540b4240 2023-11-01T03:19:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540aa9f0 con 0x7f3c54143d10 2023-11-01T03:19:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540a91a0 con 0x7f3c540ade00 2023-11-01T03:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.660+0000 7f3c5c6a2640 10 monclient(hunting): authenticate will time out at 1430.884885s 2023-11-01T03:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c59c3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c540b4240 0x7f3c540a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59536/0 (socket says 172.21.15.5:59536) 2023-11-01T03:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 1 -- 172.21.15.5:0/2708361380 learned_addr learned my addr 172.21.15.5:0/2708361380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 10 monclient(hunting): get_auth_request con 0x7f3c540ade00 auth_method 0 2023-11-01T03:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c5a43e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c59c3d640 10 monclient(hunting): get_auth_request con 0x7f3c540b4240 auth_method 0 2023-11-01T03:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c59c3d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c59c3d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.661+0000 7f3c59c3d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c59c3d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c59c3d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.662+0000 7f3c59c3d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 10 monclient(hunting): handle_auth_done global_id 4316 payload 824 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 -- 172.21.15.5:0/2708361380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c54143d10 msgr2=0x7f3c540a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c54143d10 0x7f3c540a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 -- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c540b4240 msgr2=0x7f3c540a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c540b4240 0x7f3c540a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 monclient: found mon.noname-c 2023-11-01T03:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.665+0000 7f3c5a43e640 1 -- 172.21.15.5:0/2708361380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c50009400 con 0x7f3c540ade00 2023-11-01T03:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.667+0000 7f3c5a43e640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c50034040 tx=0x7f3c500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.667+0000 7f3c4affd640 10 client.?.objecter ms_handle_connect 0x7f3c540ade00 2023-11-01T03:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.667+0000 7f3c4affd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50032840 con 0x7f3c540ade00 2023-11-01T03:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: dump: 2023-11-01T03:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c500329c0 con 0x7f3c540ade00 2023-11-01T03:19:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50032d70 con 0x7f3c540ade00 2023-11-01T03:19:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c4affd640 10 monclient: dump: 2023-11-01T03:19:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.691 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 5 monclient: authenticate success, global_id 4316 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 10 monclient: _renew_subs 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c541da890 con 0x7f3c540ade00 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c58c3b640 4 set_mon_vals no callback set 2023-11-01T03:19:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 10 client.4316.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 10 monclient: _renew_subs 2023-11-01T03:19:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541d6750 con 0x7f3c540ade00 2023-11-01T03:19:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.671+0000 7f3c5c6a2640 1 librados: init done 2023-11-01T03:19:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.672+0000 7f3c5c6a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.672+0000 7f3c5c6a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.672+0000 7f3c5c6a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.672+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c540aa860 con 0x7f3c540ade00 2023-11-01T03:19:14.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-01T03:19:14.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.702+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c5004e430 con 0x7f3c540ade00 2023-11-01T03:19:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.703+0000 7f3c4affd640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 0x7f3c3806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.703+0000 7f3c59c3d640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 0x7f3c3806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.703+0000 7f3c59c3d640 10 monclient: get_auth_request con 0x7f3c3806c850 auth_method 0 2023-11-01T03:19:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.703+0000 7f3c59c3d640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 0x7f3c3806ed10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c540aa080 tx=0x7f3c44007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.703+0000 7f3c4affd640 10 client.4316.objecter ms_handle_connect 0x7f3c3806c850 2023-11-01T03:19:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.708+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3c5007ab30 con 0x7f3c540ade00 2023-11-01T03:19:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.708+0000 7f3c4affd640 10 client.4316.objecter ms_dispatch 0x7f3c54000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.708+0000 7f3c4affd640 3 client.4316.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.708+0000 7f3c4affd640 3 client.4316.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:14.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.708+0000 7f3c4affd640 20 client.4316.objecter dump_active .. 0 homeless 2023-11-01T03:19:14.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.718+0000 7f5e5daa2640 10 monclient: get_monmap_and_config 2023-11-01T03:19:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.718+0000 7f5e5daa2640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.719+0000 7f5e5daa2640 10 monclient: monmap: 2023-11-01T03:19:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:14.719921+0000 2023-11-01T03:19:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:14.719921+0000 2023-11-01T03:19:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:14.722 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:14.722 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.719+0000 7f5e5daa2640 1 Processor -- start 2023-11-01T03:19:14.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.719+0000 7f5e5daa2640 1 -- start start 2023-11-01T03:19:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.719+0000 7f5e5daa2640 10 monclient: init 2023-11-01T03:19:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2023-11-01T03:19:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e580b4240 0x7f5e580b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-a con 0x7f5e580b4240 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5e580b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5e580ade00 0x7f5e5813b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-c con 0x7f5e580ade00 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580b0cc0 con 0x7f5e580b38d0 2023-11-01T03:19:14.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580b4620 con 0x7f5e580b4240 2023-11-01T03:19:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580b1690 con 0x7f5e580ade00 2023-11-01T03:19:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.720+0000 7f5e5daa2640 10 monclient(hunting): authenticate will time out at 1430.944405s 2023-11-01T03:19:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e577fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e580b4240 0x7f5e580b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e56ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e580b38d0 0x7f5e580ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56920/0 (socket says 172.21.15.5:56920) 2023-11-01T03:19:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e56ffd640 1 -- 172.21.15.5:0/2348000999 learned_addr learned my addr 172.21.15.5:0/2348000999 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e577fe640 10 monclient(hunting): get_auth_request con 0x7f5e580b4240 auth_method 0 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e577fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.721+0000 7f5e577fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.723+0000 7f5e577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.723+0000 7f5e577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.723+0000 7f5e577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2023-11-01T03:19:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 1 -- 172.21.15.5:0/2348000999 >> v2:172.21.15.153:3300/0 conn(0x7f5e580ade00 msgr2=0x7f5e5813b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 1 --2- 172.21.15.5:0/2348000999 >> v2:172.21.15.153:3300/0 conn(0x7f5e580ade00 0x7f5e5813b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 1 -- 172.21.15.5:0/2348000999 >> v1:172.21.15.5:6789/0 conn(0x7f5e580b38d0 legacy=0x7f5e580ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 1 monclient: found mon.noname-a 2023-11-01T03:19:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.726+0000 7f5e577fe640 1 -- 172.21.15.5:0/2348000999 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5813f5f0 con 0x7f5e580b4240 2023-11-01T03:19:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.731+0000 7f5e577fe640 1 --2- 172.21.15.5:0/2348000999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580b4240 0x7f5e580b1150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e480097a0 tx=0x7f5e4802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc682058fecc30f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 1 -- 172.21.15.5:0/2348000999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4802e070 con 0x7f5e580b4240 2023-11-01T03:19:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: dump: 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.740 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 1 -- 172.21.15.5:0/2348000999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e480315a0 con 0x7f5e580b4240 2023-11-01T03:19:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 1 -- 172.21.15.5:0/2348000999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48031930 con 0x7f5e580b4240 2023-11-01T03:19:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e5daa2640 5 monclient: authenticate success, global_id 4338 2023-11-01T03:19:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e5daa2640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e5daa2640 4 set_mon_vals no callback set 2023-11-01T03:19:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.737+0000 7f5e567fc640 10 monclient: dump: 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.745 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 10 monclient: shutdown 2023-11-01T03:19:14.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 -- 172.21.15.5:0/2348000999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580b4240 msgr2=0x7f5e580b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/2348000999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580b4240 0x7f5e580b1150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e480097a0 tx=0x7f5e4802b840 comp rx=0 tx=0).stop 2023-11-01T03:19:14.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 -- 172.21.15.5:0/2348000999 shutdown_connections 2023-11-01T03:19:14.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/2348000999 >> v2:172.21.15.153:3300/0 conn(0x7f5e580ade00 0x7f5e5813b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/2348000999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580b4240 0x7f5e580b1150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 -- 172.21.15.5:0/2348000999 >> 172.21.15.5:0/2348000999 conn(0x7f5e58065cd0 msgr2=0x7f5e580660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 -- 172.21.15.5:0/2348000999 shutdown_connections 2023-11-01T03:19:14.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 1 -- 172.21.15.5:0/2348000999 wait complete. 2023-11-01T03:19:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.738+0000 7f5e5daa2640 10 monclient: monmap: 2023-11-01T03:19:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:14.750 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:14.751 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:14.752 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 librados: starting msgr at 2023-11-01T03:19:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 librados: starting objecter 2023-11-01T03:19:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 Processor -- start 2023-11-01T03:19:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 -- start start 2023-11-01T03:19:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 librados: setting wanted keys 2023-11-01T03:19:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 librados: calling monclient init 2023-11-01T03:19:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 10 monclient: init 2023-11-01T03:19:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:19:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.739+0000 7f5e5daa2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e580ade00 0x7f5e580a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-b con 0x7f5e580ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e580b4240 0x7f5e580a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-c con 0x7f5e580b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): picked mon.noname-a con 0x7f5e580a85d0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5813ea30 con 0x7f5e580a85d0 2023-11-01T03:19:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5813d110 con 0x7f5e580ade00 2023-11-01T03:19:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58139b50 con 0x7f5e580b4240 2023-11-01T03:19:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e5daa2640 10 monclient(hunting): authenticate will time out at 1430.964025s 2023-11-01T03:19:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.740+0000 7f5e57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52360/0 (socket says 172.21.15.5:52360) 2023-11-01T03:19:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 1 -- 172.21.15.5:0/3929944385 learned_addr learned my addr 172.21.15.5:0/3929944385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): get_auth_request con 0x7f5e580a85d0 auth_method 0 2023-11-01T03:19:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.741+0000 7f5e57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 -- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e580b4240 msgr2=0x7f5e580a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e580b4240 0x7f5e580a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 -- 172.21.15.5:0/3929944385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e580ade00 msgr2=0x7f5e580a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e580ade00 0x7f5e580a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 monclient: found mon.noname-a 2023-11-01T03:19:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.744+0000 7f5e57fff640 1 -- 172.21.15.5:0/3929944385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009400 con 0x7f5e580a85d0 2023-11-01T03:19:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.746+0000 7f5e57fff640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000b970 tx=0x7f5e5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.746+0000 7f5e3ffff640 10 client.?.objecter ms_handle_connect 0x7f5e580a85d0 2023-11-01T03:19:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.746+0000 7f5e3ffff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000cb40 con 0x7f5e580a85d0 2023-11-01T03:19:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: dump: 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5000ccc0 con 0x7f5e580a85d0 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50014680 con 0x7f5e580a85d0 2023-11-01T03:19:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 5 monclient: authenticate success, global_id 4344 2023-11-01T03:19:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e3ffff640 10 monclient: dump: 2023-11-01T03:19:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.768 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e55ffb640 4 set_mon_vals no callback set 2023-11-01T03:19:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 10 monclient: _renew_subs 2023-11-01T03:19:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e58139dd0 con 0x7f5e580a85d0 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 10 monclient: _renew_subs 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5813d630 con 0x7f5e580a85d0 2023-11-01T03:19:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.751+0000 7f5e5daa2640 1 librados: init done 2023-11-01T03:19:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.753+0000 7f5e5daa2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.753+0000 7f5e5daa2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.753+0000 7f5e5daa2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.753+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e580aaee0 con 0x7f5e580a85d0 2023-11-01T03:19:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.753+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdf4003990 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.754+0000 7fbe02ffd640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 0x7fbdec06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.754+0000 7fbe0a59c640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 0x7fbdec06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.754+0000 7fbe0a59c640 10 monclient: get_auth_request con 0x7fbdec06c850 auth_method 0 2023-11-01T03:19:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.755+0000 7fbe02ffd640 10 client.4375.objecter ms_handle_connect 0x7fbdec06c850 2023-11-01T03:19:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.755+0000 7fbe0a59c640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 0x7fbdec06ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe04001560 tx=0x7fbe04001a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.756+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbdf4057e50 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.756+0000 7fbe02ffd640 10 client.4375.objecter ms_dispatch 0x7fbe0c000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.756+0000 7fbe02ffd640 3 client.4375.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.756+0000 7fbe02ffd640 3 client.4375.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.756+0000 7fbe02ffd640 20 client.4375.objecter dump_active .. 0 homeless 2023-11-01T03:19:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.766+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdf4054190 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.766+0000 7fbe02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.766+0000 7fbe02ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.774+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e5001d3b0 con 0x7f5e580a85d0 2023-11-01T03:19:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.774+0000 7f5e3ffff640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 0x7f5e4406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.774+0000 7f5e577fe640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 0x7f5e4406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.774+0000 7f5e577fe640 10 monclient: get_auth_request con 0x7f5e4406c850 auth_method 0 2023-11-01T03:19:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.775+0000 7f5e577fe640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 0x7f5e4406ed10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e48036000 tx=0x7f5e48030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.775+0000 7f5e3ffff640 10 client.4344.objecter ms_handle_connect 0x7f5e4406c850 2023-11-01T03:19:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.829+0000 7fb1d23f5640 10 monclient: get_monmap_and_config 2023-11-01T03:19:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.829+0000 7fb1d23f5640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.829+0000 7fb1d23f5640 10 monclient: monmap: 2023-11-01T03:19:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:14.830064+0000 2023-11-01T03:19:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:14.830064+0000 2023-11-01T03:19:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:14.833 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.829+0000 7fb1d23f5640 1 Processor -- start 2023-11-01T03:19:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.830+0000 7fb1d23f5640 1 -- start start 2023-11-01T03:19:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.830+0000 7fb1d23f5640 10 monclient: init 2023-11-01T03:19:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.830+0000 7fb1d23f5640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2023-11-01T03:19:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 0x7fb1cc145580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-b con 0x7fb1cc0a8cf0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb1cc145ac0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb1cc0b1520 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc1450f0 con 0x7fb1cc0b1520 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc142730 con 0x7fb1cc145ac0 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc144e50 con 0x7fb1cc0a8cf0 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1d23f5640 10 monclient(hunting): authenticate will time out at 1431.055072s 2023-11-01T03:19:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1cb7fe640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb1cc145ac0 0x7fb1cc141910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:55612/0 (socket says 172.21.15.5:55612) 2023-11-01T03:19:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.831+0000 7fb1cb7fe640 1 -- 172.21.15.5:0/4212030456 learned_addr learned my addr 172.21.15.5:0/4212030456 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267904311 0 0) 0x7fb1cc142730 con 0x7fb1cc145ac0 2023-11-01T03:19:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 10 monclient(hunting): _negotiate 2023-11-01T03:19:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 10 monclient(hunting): my global_id is 4378 2023-11-01T03:19:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.833+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b4003520 con 0x7fb1cc145ac0 2023-11-01T03:19:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687344043 0 0) 0x7fb1b4003520 con 0x7fb1cc145ac0 2023-11-01T03:19:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 msgr2=0x7fb1cc145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 0x7fb1cc145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 >> v1:172.21.15.5:6789/0 conn(0x7fb1cc0b1520 legacy=0x7fb1cc142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 monclient: found mon.noname-c-legacy 2023-11-01T03:19:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.153:6789/0 2023-11-01T03:19:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0aa9b0 con 0x7fb1cc145ac0 2023-11-01T03:19:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1534536980 0 0) 0x7fb1c0001670 con 0x7fb1cc145ac0 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: dump: 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.843 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] but i'm connected to v1:172.21.15.153:6789/0, reconnecting 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 >> v1:172.21.15.153:6789/0 conn(0x7fb1cc145ac0 legacy=0x7fb1cc141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:19:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 0x7fb1b40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient(hunting): picked mon.c con 0x7fb1cc0a8cf0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 10 monclient(hunting): picked mon.b con 0x7fb1b40040e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.838+0000 7fb1caffd640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b4004e20 0x7fb1b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): picked mon.a con 0x7fb1b4004e20 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc144e50 con 0x7fb1b4004e20 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4005530 con 0x7fb1b40040e0 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b400bec0 con 0x7fb1cc0a8cf0 2023-11-01T03:19:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.839+0000 7fb1caffd640 10 monclient(hunting): _finish_auth 0 2023-11-01T03:19:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): get_auth_request con 0x7fb1b40040e0 auth_method 0 2023-11-01T03:19:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-01T03:19:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.842+0000 7fb1cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 10 monclient(hunting): handle_auth_done global_id 4378 payload 293 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 -- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 msgr2=0x7fb1b40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc0a8cf0 0x7fb1b40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 -- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b4004e20 msgr2=0x7fb1b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b4004e20 0x7fb1b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 monclient: found mon.b 2023-11-01T03:19:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 1 -- 172.21.15.5:0/4212030456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4003520 con 0x7fb1b40040e0 2023-11-01T03:19:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1d23f5640 5 monclient: authenticate success, global_id 4378 2023-11-01T03:19:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.844+0000 7fb1d23f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.846+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1b40047c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1b40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5af7a7bf0b496 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0005ad0 con 0x7fb1b40040e0 2023-11-01T03:19:14.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: dump: 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0005c30 con 0x7fb1b40040e0 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1d23f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1d23f5640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 1 -- 172.21.15.5:0/4212030456 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c002c7c0 con 0x7fb1b40040e0 2023-11-01T03:19:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1d23f5640 4 set_mon_vals no callback set 2023-11-01T03:19:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.850+0000 7fb1caffd640 10 monclient: dump: 2023-11-01T03:19:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.862 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 10 monclient: shutdown 2023-11-01T03:19:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 -- 172.21.15.5:0/4212030456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 msgr2=0x7fb1b40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/4212030456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1b40047c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0007fd0 tx=0x7fb1b40057f0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d0992640 1 -- 172.21.15.5:0/4212030456 reap_dead start 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 -- 172.21.15.5:0/4212030456 shutdown_connections 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 -- 172.21.15.5:0/4212030456 >> 172.21.15.5:0/4212030456 conn(0x7fb1cc0b7360 msgr2=0x7fb1cc0b7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 -- 172.21.15.5:0/4212030456 shutdown_connections 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.851+0000 7fb1d23f5640 1 -- 172.21.15.5:0/4212030456 wait complete. 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.852+0000 7fb1d23f5640 10 monclient: build_initial_monmap 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.852+0000 7fb1d23f5640 10 monclient: monmap: 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:14.866 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.852+0000 7fb1d23f5640 1 librados: starting msgr at 2023-11-01T03:19:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.852+0000 7fb1d23f5640 1 librados: starting objecter 2023-11-01T03:19:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.852+0000 7fb1d23f5640 1 Processor -- start 2023-11-01T03:19:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 1 -- start start 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 1 librados: setting wanted keys 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 1 librados: calling monclient init 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 10 monclient: init 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-b con 0x7fb1b40040e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.853+0000 7fb1d23f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc1411b0 0x7fb1cc141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-a con 0x7fb1cc1411b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc1d9c00 0x7fb1cc1da080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): picked mon.noname-c con 0x7fb1cc1d9c00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1da5c0 con 0x7fb1cc1411b0 2023-11-01T03:19:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1d96e0 con 0x7fb1b40040e0 2023-11-01T03:19:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc13f810 con 0x7fb1cc1d9c00 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1d23f5640 10 monclient(hunting): authenticate will time out at 1431.078108s 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:40942/0 (socket says 172.21.15.5:40942) 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 1 -- 172.21.15.5:0/1576057287 learned_addr learned my addr 172.21.15.5:0/1576057287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 10 monclient(hunting): get_auth_request con 0x7fb1b40040e0 auth_method 0 2023-11-01T03:19:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.854+0000 7fb1cbfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.855+0000 7fb1cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.855+0000 7fb1cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.855+0000 7fb1cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2023-11-01T03:19:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 -- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc1d9c00 msgr2=0x7fb1cc1da080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc1d9c00 0x7fb1cc1da080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 -- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc1411b0 msgr2=0x7fb1cc141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc1411b0 0x7fb1cc141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 10 monclient: _finish_hunting 0 2023-11-01T03:19:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 monclient: found mon.noname-b 2023-11-01T03:19:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.858+0000 7fb1cbfff640 1 -- 172.21.15.5:0/1576057287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc142f40 con 0x7fb1b40040e0 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.860+0000 7fb1cbfff640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00b520 tx=0x7fb1bc00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.860+0000 7fb1c8ff9640 10 client.?.objecter ms_handle_connect 0x7fb1b40040e0 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.860+0000 7fb1c8ff9640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:14.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc010890 con 0x7fb1b40040e0 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: dump: 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: _finish_auth 0 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: _check_auth_tickets 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 5 monclient: authenticate success, global_id 4381 2023-11-01T03:19:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0109f0 con 0x7fb1b40040e0 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc010d80 con 0x7fb1b40040e0 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1c8ff9640 10 monclient: dump: 2023-11-01T03:19:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1ca7fc640 4 set_mon_vals no callback set 2023-11-01T03:19:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 10 monclient: _renew_subs 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc1364b0 con 0x7fb1b40040e0 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 10 monclient: _renew_subs 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc136940 con 0x7fb1b40040e0 2023-11-01T03:19:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.864+0000 7fb1d23f5640 1 librados: init done 2023-11-01T03:19:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.865+0000 7fb1d23f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.865+0000 7fb1d23f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.865+0000 7fb1d23f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.865+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc04e9f0 con 0x7fb1b40040e0 2023-11-01T03:19:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.959+0000 7fbe10a56640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.959+0000 7fbe10a56640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.959+0000 7fbe10a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.959+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbe0c04e9f0 con 0x7fbe0c0ae4d0 2023-11-01T03:19:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.982+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c50076770 con 0x7f3c540ade00 2023-11-01T03:19:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.982+0000 7f3c4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:14.982+0000 7f3c4affd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5e5000ce30 con 0x7f5e580a85d0 2023-11-01T03:19:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 10 client.4344.objecter ms_dispatch 0x7f5e58000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 3 client.4344.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 3 client.4344.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 20 client.4344.objecter dump_active .. 0 homeless 2023-11-01T03:19:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e50054940 con 0x7f5e580a85d0 2023-11-01T03:19:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.057+0000 7f5e3ffff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:15.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-01T03:19:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.109+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1bc023480 con 0x7fb1b40040e0 2023-11-01T03:19:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.110+0000 7fb1c8ff9640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 0x7fb1b806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.110+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 0x7fb1b806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.110+0000 7fb1cb7fe640 10 monclient: get_auth_request con 0x7fb1b806c830 auth_method 0 2023-11-01T03:19:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.111+0000 7fb1cb7fe640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 0x7fb1b806ecf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0034000 tx=0x7fb1c0039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.111+0000 7fb1c8ff9640 10 client.4381.objecter ms_handle_connect 0x7fb1b806c830 2023-11-01T03:19:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.115+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1bc058f50 con 0x7fb1b40040e0 2023-11-01T03:19:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.115+0000 7fb1c8ff9640 10 client.4381.objecter ms_dispatch 0x7fb1cc000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.115+0000 7fb1c8ff9640 3 client.4381.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.115+0000 7fb1c8ff9640 3 client.4381.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.115+0000 7fb1c8ff9640 20 client.4381.objecter dump_active .. 0 homeless 2023-11-01T03:19:15.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1bc054b90 con 0x7fb1b40040e0 2023-11-01T03:19:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fb1c8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fb1c8ff9640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fbe02ffd640 1 -- 172.21.15.5:0/2988658582 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdf4017020 con 0x7fbe0c0ae4d0 2023-11-01T03:19:15.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fbe02ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-01T03:19:15.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.128+0000 7fbe02ffd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:15.130 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-11-01T03:19:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 10 librados: watch_flush enter 2023-11-01T03:19:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 10 librados: watch_flush exit 2023-11-01T03:19:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 20 client.4375.objecter shutdown clearing up homeless session... 2023-11-01T03:19:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 10 client.4375.objecter successfully canceled tick 2023-11-01T03:19:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 msgr2=0x7fbdec06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 0x7fbdec06ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe04001560 tx=0x7fbe04001a90 comp rx=0 tx=0).stop 2023-11-01T03:19:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 10 monclient: shutdown 2023-11-01T03:19:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 msgr2=0x7fbe0c1d6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.131+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c400 tx=0x7fbdf400c8c0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 shutdown_connections 2023-11-01T03:19:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fbdec06c850 0x7fbdec06ed10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fbe0c13b840 0x7fbe0c1d99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe0c0ae4d0 0x7fbe0c1d6440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 --2- 172.21.15.5:0/2988658582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0abe60 0x7fbe0c070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 >> 172.21.15.5:0/2988658582 conn(0x7fbe0c0b2ff0 msgr2=0x7fbe0c13a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 shutdown_connections 2023-11-01T03:19:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 -- 172.21.15.5:0/2988658582 wait complete. 2023-11-01T03:19:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.132+0000 7fbe10a56640 1 librados: shutdown 2023-11-01T03:19:15.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-11-01T03:19:15.150 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.169+0000 7f3c5c6a2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.169+0000 7f3c5c6a2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.169+0000 7f3c5c6a2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.169+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3c540afdf0 con 0x7f3c540ade00 2023-11-01T03:19:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.176+0000 7f3c4affd640 1 -- 172.21.15.5:0/2708361380 <== mon.2 v2:172.21.15.5:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c50079d90 con 0x7f3c540ade00 2023-11-01T03:19:15.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.176+0000 7f3c4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-01T03:19:15.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.176+0000 7f3c4affd640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:15.178 INFO:teuthology.orchestra.run.smithi005.stdout:64424509446 2023-11-01T03:19:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 10 librados: watch_flush enter 2023-11-01T03:19:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 10 librados: watch_flush exit 2023-11-01T03:19:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 20 client.4316.objecter shutdown clearing up homeless session... 2023-11-01T03:19:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 10 client.4316.objecter successfully canceled tick 2023-11-01T03:19:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 msgr2=0x7f3c3806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 0x7f3c3806ed10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c540aa080 tx=0x7f3c44007e80 comp rx=0 tx=0).stop 2023-11-01T03:19:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 10 monclient: shutdown 2023-11-01T03:19:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 msgr2=0x7f3c541da350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c50034040 tx=0x7f3c500046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 shutdown_connections 2023-11-01T03:19:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f3c3806c850 0x7f3c3806ed10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c54143d10 0x7f3c540a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c540b4240 0x7f3c540a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 --2- 172.21.15.5:0/2708361380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f3c540ade00 0x7f3c541da350 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c50034040 tx=0x7f3c500046c0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 >> 172.21.15.5:0/2708361380 conn(0x7f3c54065cd0 msgr2=0x7f3c5413a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 shutdown_connections 2023-11-01T03:19:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 -- 172.21.15.5:0/2708361380 wait complete. 2023-11-01T03:19:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.179+0000 7f3c5c6a2640 1 librados: shutdown 2023-11-01T03:19:15.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2023-11-01T03:19:15.192 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 10 monclient: get_monmap_and_config 2023-11-01T03:19:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 10 monclient: build_initial_monmap 2023-11-01T03:19:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 10 monclient: monmap: 2023-11-01T03:19:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:15.217981+0000 2023-11-01T03:19:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:15.217981+0000 2023-11-01T03:19:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:15.221 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 1 Processor -- start 2023-11-01T03:19:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 1 -- start start 2023-11-01T03:19:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.217+0000 7f5649064640 10 monclient: init 2023-11-01T03:19:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2023-11-01T03:19:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f56440a8ae0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f564413f340 0x7f5644145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): picked mon.noname-a con 0x7f564413f340 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): picked mon.noname-b con 0x7f56440a8ec0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440a9600 con 0x7f56440a8ae0 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440a9360 con 0x7f564413f340 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b80b0 con 0x7f56440a8ec0 2023-11-01T03:19:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f5649064640 10 monclient(hunting): authenticate will time out at 1431.442442s 2023-11-01T03:19:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.218+0000 7f564359e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59608/0 (socket says 172.21.15.5:59608) 2023-11-01T03:19:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 1 -- 172.21.15.5:0/4088852262 learned_addr learned my addr 172.21.15.5:0/4088852262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): get_auth_request con 0x7f56440a8ec0 auth_method 0 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.219+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 10 monclient(hunting): handle_auth_done global_id 4319 payload 274 2023-11-01T03:19:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 1 -- 172.21.15.5:0/4088852262 >> v2:172.21.15.5:3300/0 conn(0x7f564413f340 msgr2=0x7f5644145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 1 --2- 172.21.15.5:0/4088852262 >> v2:172.21.15.5:3300/0 conn(0x7f564413f340 0x7f5644145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 1 -- 172.21.15.5:0/4088852262 >> v1:172.21.15.5:6789/0 conn(0x7f56440a8ae0 legacy=0x7f564413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 10 monclient: _finish_hunting 0 2023-11-01T03:19:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 1 monclient: found mon.noname-b 2023-11-01T03:19:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.221+0000 7f564359e640 1 -- 172.21.15.5:0/4088852262 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644145a80 con 0x7f56440a8ec0 2023-11-01T03:19:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.223+0000 7f564359e640 1 --2- 172.21.15.5:0/4088852262 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f563c009e50 tx=0x7f563c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb19527c8a95a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 1 -- 172.21.15.5:0/4088852262 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c02c9e0 con 0x7f56440a8ec0 2023-11-01T03:19:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: dump: 2023-11-01T03:19:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: _finish_auth 0 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: _check_auth_tickets 2023-11-01T03:19:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 1 -- 172.21.15.5:0/4088852262 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c02cb40 con 0x7f56440a8ec0 2023-11-01T03:19:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 5 monclient: authenticate success, global_id 4319 2023-11-01T03:19:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:19:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 1 -- 172.21.15.5:0/4088852262 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0343f0 con 0x7f56440a8ec0 2023-11-01T03:19:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 4 set_mon_vals no callback set 2023-11-01T03:19:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5641d9b640 10 monclient: dump: 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.240 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 10 monclient: shutdown 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 -- 172.21.15.5:0/4088852262 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 msgr2=0x7f5644145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 --2- 172.21.15.5:0/4088852262 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f563c009e50 tx=0x7f563c02be40 comp rx=0 tx=0).stop 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 -- 172.21.15.5:0/4088852262 shutdown_connections 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 --2- 172.21.15.5:0/4088852262 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ec0 0x7f5644145540 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 --2- 172.21.15.5:0/4088852262 >> v2:172.21.15.5:3300/0 conn(0x7f564413f340 0x7f5644145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.228+0000 7f5649064640 1 -- 172.21.15.5:0/4088852262 >> 172.21.15.5:0/4088852262 conn(0x7f56440b7230 msgr2=0x7f56440b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.229+0000 7f5649064640 1 -- 172.21.15.5:0/4088852262 shutdown_connections 2023-11-01T03:19:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.229+0000 7f5649064640 1 -- 172.21.15.5:0/4088852262 wait complete. 2023-11-01T03:19:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 10 monclient: build_initial_monmap 2023-11-01T03:19:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 10 monclient: monmap: 2023-11-01T03:19:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 librados: starting msgr at 2023-11-01T03:19:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 librados: starting objecter 2023-11-01T03:19:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 Processor -- start 2023-11-01T03:19:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 -- start start 2023-11-01T03:19:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 librados: setting wanted keys 2023-11-01T03:19:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 1 librados: calling monclient init 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.230+0000 7f5649064640 10 monclient: init 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 0x7f56440b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): picked mon.noname-c con 0x7f56440a8ae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56440a8ec0 0x7f5644144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): picked mon.noname-a con 0x7f56440a8ec0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 0x7f56441d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): picked mon.noname-b con 0x7f564413f340 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564413f7f0 con 0x7f56440a8ec0 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644144cb0 con 0x7f564413f340 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440b6a60 con 0x7f56440a8ae0 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5649064640 10 monclient(hunting): authenticate will time out at 1431.455369s 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.231+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 0x7f56440b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 0x7f56440b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:59618/0 (socket says 172.21.15.5:59618) 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 1 -- 172.21.15.5:0/1699857524 learned_addr learned my addr 172.21.15.5:0/1699857524 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): get_auth_request con 0x7f56440a8ae0 auth_method 0 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 0x7f56441d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): get_auth_request con 0x7f564413f340 auth_method 0 2023-11-01T03:19:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f5642d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.232+0000 7f564359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 10 monclient(hunting): handle_auth_done global_id 4384 payload 824 2023-11-01T03:19:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 -- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 msgr2=0x7f56440b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 0x7f56440b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 -- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56440a8ec0 msgr2=0x7f5644144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56440a8ec0 0x7f5644144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 10 monclient: _finish_hunting 0 2023-11-01T03:19:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 monclient: found mon.noname-b 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.235+0000 7f564359e640 1 -- 172.21.15.5:0/1699857524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c009b30 con 0x7f564413f340 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.238+0000 7f564359e640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 0x7f56441d66e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f563c032000 tx=0x7f563c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.238+0000 7f562b7fe640 10 client.?.objecter ms_handle_connect 0x7f564413f340 2023-11-01T03:19:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.238+0000 7f562b7fe640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c03e450 con 0x7f564413f340 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: dump: 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.258 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: _finish_auth 0 2023-11-01T03:19:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:19:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c03e5d0 con 0x7f564413f340 2023-11-01T03:19:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 5 monclient: authenticate success, global_id 4384 2023-11-01T03:19:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 10 monclient: _renew_subs 2023-11-01T03:19:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564413fcd0 con 0x7f564413f340 2023-11-01T03:19:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c03e780 con 0x7f564413f340 2023-11-01T03:19:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f562b7fe640 10 monclient: dump: 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.262 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f564159a640 4 set_mon_vals no callback set 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 10 monclient: _renew_subs 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56441d6c20 con 0x7f564413f340 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.243+0000 7f5649064640 1 librados: init done 2023-11-01T03:19:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.244+0000 7f5649064640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.244+0000 7f5649064640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.244+0000 7f5649064640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.244+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564413f9b0 con 0x7f564413f340 2023-11-01T03:19:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.276+0000 7f5e5daa2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.276+0000 7f5e5daa2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.276+0000 7f5e5daa2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:19:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.276+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e580aaee0 con 0x7f5e580a85d0 2023-11-01T03:19:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.325+0000 7fb1d23f5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.325+0000 7fb1d23f5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.325+0000 7fb1d23f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.325+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1cc1430d0 con 0x7fb1b40040e0 2023-11-01T03:19:15.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.332+0000 7f5e3ffff640 1 -- 172.21.15.5:0/3929944385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e580aaee0 con 0x7f5e580a85d0 2023-11-01T03:19:15.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.332+0000 7f5e3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-01T03:19:15.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.332+0000 7f5e3ffff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:15.333 INFO:teuthology.orchestra.run.smithi005.stdout:73014444037 2023-11-01T03:19:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 10 librados: watch_flush enter 2023-11-01T03:19:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 10 librados: watch_flush exit 2023-11-01T03:19:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 20 client.4344.objecter shutdown clearing up homeless session... 2023-11-01T03:19:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 10 client.4344.objecter successfully canceled tick 2023-11-01T03:19:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 msgr2=0x7f5e4406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 0x7f5e4406ed10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e48036000 tx=0x7f5e48030000 comp rx=0 tx=0).stop 2023-11-01T03:19:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 10 monclient: shutdown 2023-11-01T03:19:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 msgr2=0x7f5e58139610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000b970 tx=0x7f5e5000be30 comp rx=0 tx=0).stop 2023-11-01T03:19:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 shutdown_connections 2023-11-01T03:19:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f5e4406c850 0x7f5e4406ed10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e580a85d0 0x7f5e58139610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f5e580b4240 0x7f5e580a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 --2- 172.21.15.5:0/3929944385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e580ade00 0x7f5e580a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 >> 172.21.15.5:0/3929944385 conn(0x7f5e58065cd0 msgr2=0x7f5e580b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 shutdown_connections 2023-11-01T03:19:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.334+0000 7f5e5daa2640 1 -- 172.21.15.5:0/3929944385 wait complete. 2023-11-01T03:19:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.335+0000 7f5e5daa2640 1 librados: shutdown 2023-11-01T03:19:15.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.2 2023-11-01T03:19:15.347 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.491+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f563c03e8e0 con 0x7f564413f340 2023-11-01T03:19:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.491+0000 7f562b7fe640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 0x7f563006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.491+0000 7f5642d9d640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 0x7f563006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.491+0000 7f5642d9d640 10 monclient: get_auth_request con 0x7f563006c800 auth_method 0 2023-11-01T03:19:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.492+0000 7f562b7fe640 10 client.4384.objecter ms_handle_connect 0x7f563006c800 2023-11-01T03:19:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.492+0000 7f5642d9d640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 0x7f563006ecc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5634001800 tx=0x7f5634009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.494+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f563c07bc30 con 0x7f564413f340 2023-11-01T03:19:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.494+0000 7f562b7fe640 10 client.4384.objecter ms_dispatch 0x7f5644000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.494+0000 7f562b7fe640 3 client.4384.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.494+0000 7f562b7fe640 3 client.4384.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.494+0000 7f562b7fe640 20 client.4384.objecter dump_active .. 0 homeless 2023-11-01T03:19:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.508+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f563c077870 con 0x7f564413f340 2023-11-01T03:19:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.508+0000 7f562b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.508+0000 7f562b7fe640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.516+0000 7fb1c8ff9640 1 -- 172.21.15.5:0/1576057287 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1bc01e020 con 0x7fb1b40040e0 2023-11-01T03:19:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.516+0000 7fb1c8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-01T03:19:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.516+0000 7fb1c8ff9640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:15.519 INFO:teuthology.orchestra.run.smithi005.stdout:68719476741 2023-11-01T03:19:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 10 librados: watch_flush enter 2023-11-01T03:19:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 10 librados: watch_flush exit 2023-11-01T03:19:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 20 client.4381.objecter shutdown clearing up homeless session... 2023-11-01T03:19:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 10 client.4381.objecter successfully canceled tick 2023-11-01T03:19:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 msgr2=0x7fb1b806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 0x7fb1b806ecf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0034000 tx=0x7fb1c0039040 comp rx=0 tx=0).stop 2023-11-01T03:19:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 10 monclient: shutdown 2023-11-01T03:19:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 msgr2=0x7fb1cc1404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.518+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00b520 tx=0x7fb1bc00b9e0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 shutdown_connections 2023-11-01T03:19:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb1b806c830 0x7fb1b806ecf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb1cc1d9c00 0x7fb1cc1da080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1cc1411b0 0x7fb1cc141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 --2- 172.21.15.5:0/1576057287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b40040e0 0x7fb1cc1404a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 >> 172.21.15.5:0/1576057287 conn(0x7fb1cc0b7360 msgr2=0x7fb1cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 shutdown_connections 2023-11-01T03:19:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 -- 172.21.15.5:0/1576057287 wait complete. 2023-11-01T03:19:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.519+0000 7fb1d23f5640 1 librados: shutdown 2023-11-01T03:19:15.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.1 2023-11-01T03:19:15.531 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.718+0000 7f5649064640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.718+0000 7f5649064640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.718+0000 7f5649064640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.718+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56440b6ba0 con 0x7f564413f340 2023-11-01T03:19:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.723+0000 7f562b7fe640 1 -- 172.21.15.5:0/1699857524 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f563c07ae90 con 0x7f564413f340 2023-11-01T03:19:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.723+0000 7f562b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-01T03:19:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.723+0000 7f562b7fe640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:15.724 INFO:teuthology.orchestra.run.smithi005.stdout:68719476741 2023-11-01T03:19:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.724+0000 7f5649064640 10 librados: watch_flush enter 2023-11-01T03:19:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.724+0000 7f5649064640 10 librados: watch_flush exit 2023-11-01T03:19:15.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.724+0000 7f5649064640 20 client.4384.objecter shutdown clearing up homeless session... 2023-11-01T03:19:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.724+0000 7f5649064640 10 client.4384.objecter successfully canceled tick 2023-11-01T03:19:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 msgr2=0x7f563006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 0x7f563006ecc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5634001800 tx=0x7f5634009040 comp rx=0 tx=0).stop 2023-11-01T03:19:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 10 monclient: shutdown 2023-11-01T03:19:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 msgr2=0x7f56441d66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 0x7f56441d66e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f563c032000 tx=0x7f563c004a40 comp rx=0 tx=0).stop 2023-11-01T03:19:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 shutdown_connections 2023-11-01T03:19:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f563006c800 0x7f563006ecc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f564413f340 0x7f56441d66e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56440a8ec0 0x7f5644144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 --2- 172.21.15.5:0/1699857524 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f56440a8ae0 0x7f56440b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 >> 172.21.15.5:0/1699857524 conn(0x7f56440b7230 msgr2=0x7f5644136f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 shutdown_connections 2023-11-01T03:19:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 -- 172.21.15.5:0/1699857524 wait complete. 2023-11-01T03:19:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.725+0000 7f5649064640 1 librados: shutdown 2023-11-01T03:19:15.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.3 2023-11-01T03:19:15.737 DEBUG:teuthology.parallel:result is None 2023-11-01T03:19:15.737 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-01T03:19:15.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:19:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.842+0000 7fcba809b640 10 monclient: get_monmap_and_config 2023-11-01T03:19:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.842+0000 7fcba809b640 10 monclient: build_initial_monmap 2023-11-01T03:19:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.842+0000 7fcba809b640 10 monclient: monmap: 2023-11-01T03:19:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:15.843571+0000 2023-11-01T03:19:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:15.843571+0000 2023-11-01T03:19:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:15.846 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.843+0000 7fcba809b640 1 Processor -- start 2023-11-01T03:19:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.843+0000 7fcba809b640 1 -- start start 2023-11-01T03:19:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.843+0000 7fcba809b640 10 monclient: init 2023-11-01T03:19:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2023-11-01T03:19:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba00adc40 0x7fcba00ac720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-b con 0x7fcba00adc40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcba00aafc0 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcba013f0b0 0x7fcba00acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-a con 0x7fcba013f0b0 addr v2:172.21.15.5:3300/0 2023-11-01T03:19:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba00ad1a0 con 0x7fcba00aafc0 2023-11-01T03:19:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba00ae020 con 0x7fcba013f0b0 2023-11-01T03:19:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00a9f60 con 0x7fcba00adc40 2023-11-01T03:19:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba809b640 10 monclient(hunting): authenticate will time out at 1432.068140s 2023-11-01T03:19:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba6638640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcba013f0b0 0x7fcba00acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba5e37640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba00adc40 0x7fcba00ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba5636640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcba00aafc0 0x7fcba013e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:55618/0 (socket says 172.21.15.5:55618) 2023-11-01T03:19:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba5636640 1 -- 172.21.15.5:0/1856078993 learned_addr learned my addr 172.21.15.5:0/1856078993 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba6638640 10 monclient(hunting): get_auth_request con 0x7fcba013f0b0 auth_method 0 2023-11-01T03:19:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba6638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba6638640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.844+0000 7fcba6638640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): get_auth_request con 0x7fcba00adc40 auth_method 0 2023-11-01T03:19:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.845+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 1 -- 172.21.15.5:0/1856078993 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167170346 0 0) 0x7fcba00ad1a0 con 0x7fcba00aafc0 2023-11-01T03:19:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 10 monclient(hunting): _negotiate 2023-11-01T03:19:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 10 monclient(hunting): my global_id is 4387 2023-11-01T03:19:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba4e35640 1 -- 172.21.15.5:0/1856078993 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb8c003520 con 0x7fcba00aafc0 2023-11-01T03:19:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 10 monclient(hunting): handle_auth_done global_id 4347 payload 274 2023-11-01T03:19:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 1 -- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba00adc40 msgr2=0x7fcba00ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:19:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 1 --2- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba00adc40 0x7fcba00ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 1 -- 172.21.15.5:0/1856078993 >> v1:172.21.15.153:6789/0 conn(0x7fcba00aafc0 legacy=0x7fcba013e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 10 monclient: _finish_hunting 0 2023-11-01T03:19:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 1 monclient: found mon.noname-a 2023-11-01T03:19:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:19:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.847+0000 7fcba6638640 1 -- 172.21.15.5:0/1856078993 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00ac300 con 0x7fcba013f0b0 2023-11-01T03:19:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.849+0000 7fcba6638640 1 --2- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba00acc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb9802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc83e63a7d1a459 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 1 -- 172.21.15.5:0/1856078993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9802cb30 con 0x7fcba013f0b0 2023-11-01T03:19:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:19:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: dump: 2023-11-01T03:19:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.866 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: _finish_auth 0 2023-11-01T03:19:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: _check_auth_tickets 2023-11-01T03:19:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 1 -- 172.21.15.5:0/1856078993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9802cc90 con 0x7fcba013f0b0 2023-11-01T03:19:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 1 -- 172.21.15.5:0/1856078993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98034440 con 0x7fcba013f0b0 2023-11-01T03:19:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba809b640 5 monclient: authenticate success, global_id 4347 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba809b640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba809b640 4 set_mon_vals no callback set 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.852+0000 7fcba4e35640 10 monclient: dump: 2023-11-01T03:19:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.870 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 10 monclient: shutdown 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 -- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 msgr2=0x7fcba00acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 --2- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba00acc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb9802bd80 comp rx=0 tx=0).stop 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 -- 172.21.15.5:0/1856078993 shutdown_connections 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 --2- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba00acc60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 --2- 172.21.15.5:0/1856078993 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba00adc40 0x7fcba00ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 -- 172.21.15.5:0/1856078993 >> 172.21.15.5:0/1856078993 conn(0x7fcba00b2ff0 msgr2=0x7fcba00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 -- 172.21.15.5:0/1856078993 shutdown_connections 2023-11-01T03:19:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.853+0000 7fcba809b640 1 -- 172.21.15.5:0/1856078993 wait complete. 2023-11-01T03:19:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 10 monclient: build_initial_monmap 2023-11-01T03:19:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 10 monclient: monmap: 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:15.874 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 librados: starting msgr at 2023-11-01T03:19:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 librados: starting objecter 2023-11-01T03:19:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 Processor -- start 2023-11-01T03:19:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 -- start start 2023-11-01T03:19:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 librados: setting wanted keys 2023-11-01T03:19:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 1 librados: calling monclient init 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.854+0000 7fcba809b640 10 monclient: init 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 0x7fcba013d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-b con 0x7fcba00adc40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-a con 0x7fcba013f0b0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 0x7fcba012e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): picked mon.noname-c con 0x7fcba012ded0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0141b10 con 0x7fcba013f0b0 2023-11-01T03:19:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0139400 con 0x7fcba00adc40 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0141d60 con 0x7fcba012ded0 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.855+0000 7fcba809b640 10 monclient(hunting): authenticate will time out at 1432.079479s 2023-11-01T03:19:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 0x7fcba012e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52396/0 (socket says 172.21.15.5:52396) 2023-11-01T03:19:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 1 -- 172.21.15.5:0/410422766 learned_addr learned my addr 172.21.15.5:0/410422766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): get_auth_request con 0x7fcba013f0b0 auth_method 0 2023-11-01T03:19:15.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): get_auth_request con 0x7fcba012ded0 auth_method 0 2023-11-01T03:19:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5e37640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 0x7fcba013d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5e37640 10 monclient(hunting): get_auth_request con 0x7fcba00adc40 auth_method 0 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5e37640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5e37640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba5636640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.856+0000 7fcba6638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.857+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.857+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.857+0000 7fcba5e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 10 monclient(hunting): handle_auth_done global_id 4328 payload 824 2023-11-01T03:19:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 -- 172.21.15.5:0/410422766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 msgr2=0x7fcba013d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 0x7fcba013d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 -- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 msgr2=0x7fcba01415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 10 monclient: _finish_hunting 0 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 monclient: found mon.noname-c 2023-11-01T03:19:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba6638640 1 -- 172.21.15.5:0/410422766 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98009a70 con 0x7fcba012ded0 2023-11-01T03:19:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba5e37640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 0x7fcba013d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-01T03:19:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.859+0000 7fcba5636640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-01T03:19:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.862+0000 7fcba6638640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 0x7fcba012e380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb98033000 tx=0x7fcb98004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.862+0000 7fcb967fc640 10 client.?.objecter ms_handle_connect 0x7fcba012ded0 2023-11-01T03:19:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.862+0000 7fcb967fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98035e70 con 0x7fcba012ded0 2023-11-01T03:19:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: dump: 2023-11-01T03:19:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.890 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9803e410 con 0x7fcba012ded0 2023-11-01T03:19:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcba809b640 5 monclient: authenticate success, global_id 4328 2023-11-01T03:19:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9803e7c0 con 0x7fcba012ded0 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb967fc640 10 monclient: dump: 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:15.894 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:15.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcb97fff640 4 set_mon_vals no callback set 2023-11-01T03:19:15.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcba809b640 10 monclient: _renew_subs 2023-11-01T03:19:15.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcba809b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.865+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba012e8c0 con 0x7fcba012ded0 2023-11-01T03:19:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.866+0000 7fcba809b640 10 client.4328.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.866+0000 7fcba809b640 10 monclient: _renew_subs 2023-11-01T03:19:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.866+0000 7fcba809b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.866+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0140ef0 con 0x7fcba012ded0 2023-11-01T03:19:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.866+0000 7fcba809b640 1 librados: init done 2023-11-01T03:19:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.867+0000 7fcba809b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.867+0000 7fcba809b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.867+0000 7fcba809b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:19:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.867+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004e9f0 con 0x7fcba012ded0 2023-11-01T03:19:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.886+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcb9803b050 con 0x7fcba012ded0 2023-11-01T03:19:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.886+0000 7fcb967fc640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 0x7fcb8406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.887+0000 7fcba5e37640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 0x7fcb8406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.887+0000 7fcba5e37640 10 monclient: get_auth_request con 0x7fcb8406c880 auth_method 0 2023-11-01T03:19:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.887+0000 7fcba5e37640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 0x7fcb8406ed40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009f30 tx=0x7fcb9c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:15.887+0000 7fcb967fc640 10 client.4328.objecter ms_handle_connect 0x7fcb8406c880 2023-11-01T03:19:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcb9807b330 con 0x7fcba012ded0 2023-11-01T03:19:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 10 client.4328.objecter ms_dispatch 0x7fcba0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 3 client.4328.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 3 client.4328.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 20 client.4328.objecter dump_active .. 0 homeless 2023-11-01T03:19:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb98077670 con 0x7fcba012ded0 2023-11-01T03:19:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.141+0000 7fcb967fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:16.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.317+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcba013c1d0 con 0x7fcb8406c880 2023-11-01T03:19:16.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.319+0000 7fcb967fc640 1 -- 172.21.15.5:0/410422766 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48042 (secure 0 0 0) 0x7fcb9c009c60 con 0x7fcb8406c880 2023-11-01T03:19:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:16.321 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:19:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.321+0000 7fcba809b640 10 librados: watch_flush enter 2023-11-01T03:19:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.321+0000 7fcba809b640 10 librados: watch_flush exit 2023-11-01T03:19:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.321+0000 7fcba809b640 20 client.4328.objecter shutdown clearing up homeless session... 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.321+0000 7fcba809b640 10 client.4328.objecter successfully canceled tick 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 msgr2=0x7fcb8406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 0x7fcb8406ed40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009f30 tx=0x7fcb9c009190 comp rx=0 tx=0).stop 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 10 monclient: shutdown 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:16.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 msgr2=0x7fcba012e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 0x7fcba012e380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb98033000 tx=0x7fcb98004a40 comp rx=0 tx=0).stop 2023-11-01T03:19:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 shutdown_connections 2023-11-01T03:19:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb8406c880 0x7fcb8406ed40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcba012ded0 0x7fcba012e380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcba013f0b0 0x7fcba01415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 --2- 172.21.15.5:0/410422766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba00adc40 0x7fcba013d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 >> 172.21.15.5:0/410422766 conn(0x7fcba00b2ff0 msgr2=0x7fcba00ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 shutdown_connections 2023-11-01T03:19:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 -- 172.21.15.5:0/410422766 wait complete. 2023-11-01T03:19:16.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.322+0000 7fcba809b640 1 librados: shutdown 2023-11-01T03:19:16.334 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-01T03:19:15.156718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218932,"kb_used_data":2384,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755788,"statfs":{"total":773094113280,"available":772869926912,"internally_reserved":0,"allocated":2441216,"data_stored":1356864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.549746"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.197036+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:19:11.197036+0000","last_peered":"2023-11-01T03:19:11.197036+0000","last_clean":"2023-11-01T03:19:11.197036+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:19:11.197036+0000","last_undegraded":"2023-11-01T03:19:11.197036+0000","last_fullsized":"2023-11-01T03:19:11.197036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.167048+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:19:11.167048+0000","last_peered":"2023-11-01T03:19:11.167048+0000","last_clean":"2023-11-01T03:19:11.167048+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:19:11.167048+0000","last_undegraded":"2023-11-01T03:19:11.167048+0000","last_fullsized":"2023-11-01T03:19:11.167048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:05:15.577920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.199781+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:19:11.199781+0000","last_peered":"2023-11-01T03:19:11.199781+0000","last_clean":"2023-11-01T03:19:11.199781+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:19:11.199781+0000","last_undegraded":"2023-11-01T03:19:11.199781+0000","last_fullsized":"2023-11-01T03:19:11.199781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:10.759673+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:19:10.759673+0000","last_peered":"2023-11-01T03:19:10.759673+0000","last_clean":"2023-11-01T03:19:10.759673+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:19:10.759673+0000","last_undegraded":"2023-11-01T03:19:10.759673+0000","last_fullsized":"2023-11-01T03:19:10.759673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.173182+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:19:11.173182+0000","last_peered":"2023-11-01T03:19:11.173182+0000","last_clean":"2023-11-01T03:19:11.173182+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:19:11.173182+0000","last_undegraded":"2023-11-01T03:19:11.173182+0000","last_fullsized":"2023-11-01T03:19:11.173182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.006386+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:19:11.006386+0000","last_peered":"2023-11-01T03:19:11.006386+0000","last_clean":"2023-11-01T03:19:11.006386+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:19:11.006386+0000","last_undegraded":"2023-11-01T03:19:11.006386+0000","last_fullsized":"2023-11-01T03:19:11.006386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.182543+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:19:11.182543+0000","last_peered":"2023-11-01T03:19:11.182543+0000","last_clean":"2023-11-01T03:19:11.182543+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:19:11.182543+0000","last_undegraded":"2023-11-01T03:19:11.182543+0000","last_fullsized":"2023-11-01T03:19:11.182543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.187124+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:19:11.187124+0000","last_peered":"2023-11-01T03:19:11.187124+0000","last_clean":"2023-11-01T03:19:11.187124+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:19:11.187124+0000","last_undegraded":"2023-11-01T03:19:11.187124+0000","last_fullsized":"2023-11-01T03:19:11.187124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":117,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.324758+0000","last_change":"2023-11-01T03:19:01.879653+0000","last_active":"2023-11-01T03:19:11.324758+0000","last_peered":"2023-11-01T03:19:11.324758+0000","last_clean":"2023-11-01T03:19:11.324758+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:19:11.324758+0000","last_undegraded":"2023-11-01T03:19:11.324758+0000","last_fullsized":"2023-11-01T03:19:11.324758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_clean_scrub_stamp":"2023-11-01T03:18:57.938958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:10:19.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.475999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.356}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.745000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.606999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":36.213000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.100999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.347}]}]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":606208,"data_stored":467988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.061999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.097}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.666}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.547999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.096}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.701000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.096}]}]},{"osd":3,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3049999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.583}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":33.353000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.188000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":32.143000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.111000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.013999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1240000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":70.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":66.536000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.823}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.329000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7320000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":606208,"data_stored":467988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8049999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.031000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.301}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.172999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.65}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.297000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.902000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.393000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.382999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.592000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.992999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.946}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3419999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6370000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.215}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.16}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.5099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.847}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.585999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.105}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.951000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.943}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.491}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.590999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8520000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.858000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:19:16.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:19:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.443+0000 7fcbbbbe7640 10 monclient: get_monmap_and_config 2023-11-01T03:19:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.443+0000 7fcbbbbe7640 10 monclient: build_initial_monmap 2023-11-01T03:19:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.443+0000 7fcbbbbe7640 10 monclient: monmap: 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:16.444242+0000 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:16.444242+0000 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:16.447 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.443+0000 7fcbbbbe7640 1 Processor -- start 2023-11-01T03:19:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 1 -- start start 2023-11-01T03:19:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient: init 2023-11-01T03:19:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2023-11-01T03:19:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcbb40a8720 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcbb4141a80 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbb413ebf0 0x7fcbb413f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-c con 0x7fcbb413ebf0 addr v2:172.21.15.153:3300/0 2023-11-01T03:19:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb4141fa0 con 0x7fcbb40a8720 2023-11-01T03:19:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40aa500 con 0x7fcbb4141a80 2023-11-01T03:19:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40a8b00 con 0x7fcbb413ebf0 2023-11-01T03:19:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.444+0000 7fcbbbbe7640 10 monclient(hunting): authenticate will time out at 1432.668677s 2023-11-01T03:19:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.445+0000 7fcbb9983640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcbb40a8720 0x7fcbb4142430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56946/0 (socket says 172.21.15.5:56946) 2023-11-01T03:19:16.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.445+0000 7fcbb9983640 1 -- 172.21.15.5:0/1368398724 learned_addr learned my addr 172.21.15.5:0/1368398724 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.445+0000 7fcbba184640 1 --2- 172.21.15.5:0/1368398724 >> v2:172.21.15.153:3300/0 conn(0x7fcbb413ebf0 0x7fcbb413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.446+0000 7fcbba184640 10 monclient(hunting): get_auth_request con 0x7fcbb413ebf0 auth_method 0 2023-11-01T03:19:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.446+0000 7fcbba184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.446+0000 7fcbba184640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.446+0000 7fcbba184640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 1 -- 172.21.15.5:0/1368398724 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307930564 0 0) 0x7fcbb4141fa0 con 0x7fcbb40a8720 2023-11-01T03:19:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 10 monclient(hunting): _negotiate 2023-11-01T03:19:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 10 monclient(hunting): my global_id is 4353 2023-11-01T03:19:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.447+0000 7fcbb8981640 1 -- 172.21.15.5:0/1368398724 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba0003520 con 0x7fcbb40a8720 2023-11-01T03:19:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 10 monclient(hunting): handle_auth_done global_id 4393 payload 274 2023-11-01T03:19:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 1 -- 172.21.15.5:0/1368398724 >> v1:172.21.15.153:6789/0 conn(0x7fcbb4141a80 legacy=0x7fcbb40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 1 -- 172.21.15.5:0/1368398724 >> v1:172.21.15.5:6789/0 conn(0x7fcbb40a8720 legacy=0x7fcbb4142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 10 monclient: _finish_hunting 0 2023-11-01T03:19:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 1 monclient: found mon.noname-c 2023-11-01T03:19:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:19:16.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.449+0000 7fcbba184640 1 -- 172.21.15.5:0/1368398724 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40aa770 con 0x7fcbb413ebf0 2023-11-01T03:19:16.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.453+0000 7fcbba184640 1 --2- 172.21.15.5:0/1368398724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb413f040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009d90 tx=0x7fcbb002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4dc13eae5f840f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 1 -- 172.21.15.5:0/1368398724 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb002cc60 con 0x7fcbb413ebf0 2023-11-01T03:19:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:16.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:19:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: dump: 2023-11-01T03:19:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.460 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:16.461 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:16.462 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: _finish_auth 0 2023-11-01T03:19:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: _check_auth_tickets 2023-11-01T03:19:16.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 1 -- 172.21.15.5:0/1368398724 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb002cdc0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 1 -- 172.21.15.5:0/1368398724 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0034660 con 0x7fcbb413ebf0 2023-11-01T03:19:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbbbbe7640 5 monclient: authenticate success, global_id 4393 2023-11-01T03:19:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbbbbe7640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbbbbe7640 4 set_mon_vals no callback set 2023-11-01T03:19:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.457+0000 7fcbb8981640 10 monclient: dump: 2023-11-01T03:19:16.464 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.465 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:16.466 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 10 monclient: shutdown 2023-11-01T03:19:16.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/1368398724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 msgr2=0x7fcbb413f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/1368398724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb413f040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009d90 tx=0x7fcbb002beb0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/1368398724 shutdown_connections 2023-11-01T03:19:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/1368398724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb413f040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/1368398724 >> 172.21.15.5:0/1368398724 conn(0x7fcbb40b7280 msgr2=0x7fcbb40b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/1368398724 shutdown_connections 2023-11-01T03:19:16.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.458+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/1368398724 wait complete. 2023-11-01T03:19:16.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 10 monclient: build_initial_monmap 2023-11-01T03:19:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 10 monclient: monmap: 2023-11-01T03:19:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:16.474 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 librados: starting msgr at 2023-11-01T03:19:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 librados: starting objecter 2023-11-01T03:19:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 Processor -- start 2023-11-01T03:19:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 -- start start 2023-11-01T03:19:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 librados: setting wanted keys 2023-11-01T03:19:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 1 librados: calling monclient init 2023-11-01T03:19:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.459+0000 7fcbbbbe7640 10 monclient: init 2023-11-01T03:19:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:16.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:19:16.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcbb40a8720 0x7fcbb4143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:16.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-c con 0x7fcbb40a8720 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:16.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:16.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-b con 0x7fcbb413ebf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 0x7fcbb40b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): picked mon.noname-a con 0x7fcbb40b1240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40af1f0 con 0x7fcbb40b1240 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:16.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40b0b30 con 0x7fcbb413ebf0 2023-11-01T03:19:16.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:16.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40af3f0 con 0x7fcbb40a8720 2023-11-01T03:19:16.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:16.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbbbbe7640 10 monclient(hunting): authenticate will time out at 1432.684296s 2023-11-01T03:19:16.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbba184640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 0x7fcbb40b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbb9983640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcbb40a8720 0x7fcbb4143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.460+0000 7fcbb9182640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 0x7fcbb40b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52402/0 (socket says 172.21.15.5:52402) 2023-11-01T03:19:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 1 -- 172.21.15.5:0/2016153104 learned_addr learned my addr 172.21.15.5:0/2016153104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): get_auth_request con 0x7fcbb40b1240 auth_method 0 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): get_auth_request con 0x7fcbb40a8720 auth_method 0 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:16.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:16.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:16.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): get_auth_request con 0x7fcbb413ebf0 auth_method 0 2023-11-01T03:19:16.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:16.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:16.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:16.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:16.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:16.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbba184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:16.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:16.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:16.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9983640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:16.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:16.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:16.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.461+0000 7fcbb9182640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:16.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2023-11-01T03:19:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 -- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcbb40a8720 msgr2=0x7fcbb4143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcbb40a8720 0x7fcbb4143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 -- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 msgr2=0x7fcbb40b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 0x7fcbb40b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 10 monclient: _finish_hunting 0 2023-11-01T03:19:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 monclient: found mon.noname-b 2023-11-01T03:19:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.464+0000 7fcbb9182640 1 -- 172.21.15.5:0/2016153104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009a70 con 0x7fcbb413ebf0 2023-11-01T03:19:16.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.466+0000 7fcbb9182640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb40b00b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c3c0 tx=0x7fcba400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.466+0000 7fcbaa7fc640 10 client.?.objecter ms_handle_connect 0x7fcbb413ebf0 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.466+0000 7fcbaa7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba40052d0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: dump: 2023-11-01T03:19:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:16.488 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:16.488 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba4005450 con 0x7fcbb413ebf0 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:16.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4007260 con 0x7fcbb413ebf0 2023-11-01T03:19:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbaa7fc640 10 monclient: dump: 2023-11-01T03:19:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:16.490 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:16.491 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:16.492 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 5 monclient: authenticate success, global_id 4399 2023-11-01T03:19:16.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 10 monclient: _renew_subs 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbab7fe640 4 set_mon_vals no callback set 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb40af6d0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 10 monclient: _renew_subs 2023-11-01T03:19:16.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41442c0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.470+0000 7fcbbbbe7640 1 librados: init done 2023-11-01T03:19:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.471+0000 7fcbbbbe7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.471+0000 7fcbbbbe7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:16.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.471+0000 7fcbbbbe7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:16.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.471+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40ae870 con 0x7fcbb413ebf0 2023-11-01T03:19:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.488+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcba40073c0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.488+0000 7fcbaa7fc640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 0x7fcb9806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:16.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.489+0000 7fcbb9983640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 0x7fcb9806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.489+0000 7fcbb9983640 10 monclient: get_auth_request con 0x7fcb9806c850 auth_method 0 2023-11-01T03:19:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.489+0000 7fcbb9983640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 0x7fcb9806ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0011e0 tx=0x7fcbac007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.489+0000 7fcbaa7fc640 10 client.4399.objecter ms_handle_connect 0x7fcb9806c850 2023-11-01T03:19:16.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.490+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcba4057ce0 con 0x7fcbb413ebf0 2023-11-01T03:19:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.490+0000 7fcbaa7fc640 10 client.4399.objecter ms_dispatch 0x7fcbb4000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.490+0000 7fcbaa7fc640 3 client.4399.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.490+0000 7fcbaa7fc640 3 client.4399.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.491+0000 7fcbaa7fc640 20 client.4399.objecter dump_active .. 0 homeless 2023-11-01T03:19:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.733+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcba4054020 con 0x7fcbb413ebf0 2023-11-01T03:19:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.733+0000 7fcbaa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.733+0000 7fcbaa7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.910+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbb414d340 con 0x7fcb9806c850 2023-11-01T03:19:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.911+0000 7fcbaa7fc640 1 -- 172.21.15.5:0/2016153104 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48042 (secure 0 0 0) 0x7fcbac0014d0 con 0x7fcb9806c850 2023-11-01T03:19:16.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:19:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 10 librados: watch_flush enter 2023-11-01T03:19:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 10 librados: watch_flush exit 2023-11-01T03:19:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 20 client.4399.objecter shutdown clearing up homeless session... 2023-11-01T03:19:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 10 client.4399.objecter successfully canceled tick 2023-11-01T03:19:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 msgr2=0x7fcb9806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 0x7fcb9806ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0011e0 tx=0x7fcbac007d30 comp rx=0 tx=0).stop 2023-11-01T03:19:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 10 monclient: shutdown 2023-11-01T03:19:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 msgr2=0x7fcbb40b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb40b00b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c3c0 tx=0x7fcba400c880 comp rx=0 tx=0).stop 2023-11-01T03:19:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 shutdown_connections 2023-11-01T03:19:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcb9806c850 0x7fcb9806ed10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb40b1240 0x7fcbb40b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbb413ebf0 0x7fcbb40b00b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.913+0000 7fcbbbbe7640 1 --2- 172.21.15.5:0/2016153104 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcbb40a8720 0x7fcbb4143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.914+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 >> 172.21.15.5:0/2016153104 conn(0x7fcbb40b7280 msgr2=0x7fcbb40b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.914+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 shutdown_connections 2023-11-01T03:19:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.914+0000 7fcbbbbe7640 1 -- 172.21.15.5:0/2016153104 wait complete. 2023-11-01T03:19:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:16.914+0000 7fcbbbbe7640 1 librados: shutdown 2023-11-01T03:19:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-01T03:19:15.156718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218932,"kb_used_data":2384,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755788,"statfs":{"total":773094113280,"available":772869926912,"internally_reserved":0,"allocated":2441216,"data_stored":1356864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.549746"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.197036+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:19:11.197036+0000","last_peered":"2023-11-01T03:19:11.197036+0000","last_clean":"2023-11-01T03:19:11.197036+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:19:11.197036+0000","last_undegraded":"2023-11-01T03:19:11.197036+0000","last_fullsized":"2023-11-01T03:19:11.197036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.167048+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:19:11.167048+0000","last_peered":"2023-11-01T03:19:11.167048+0000","last_clean":"2023-11-01T03:19:11.167048+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:19:11.167048+0000","last_undegraded":"2023-11-01T03:19:11.167048+0000","last_fullsized":"2023-11-01T03:19:11.167048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:05:15.577920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.199781+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:19:11.199781+0000","last_peered":"2023-11-01T03:19:11.199781+0000","last_clean":"2023-11-01T03:19:11.199781+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:19:11.199781+0000","last_undegraded":"2023-11-01T03:19:11.199781+0000","last_fullsized":"2023-11-01T03:19:11.199781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:10.759673+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:19:10.759673+0000","last_peered":"2023-11-01T03:19:10.759673+0000","last_clean":"2023-11-01T03:19:10.759673+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:19:10.759673+0000","last_undegraded":"2023-11-01T03:19:10.759673+0000","last_fullsized":"2023-11-01T03:19:10.759673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.173182+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:19:11.173182+0000","last_peered":"2023-11-01T03:19:11.173182+0000","last_clean":"2023-11-01T03:19:11.173182+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:19:11.173182+0000","last_undegraded":"2023-11-01T03:19:11.173182+0000","last_fullsized":"2023-11-01T03:19:11.173182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.006386+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:19:11.006386+0000","last_peered":"2023-11-01T03:19:11.006386+0000","last_clean":"2023-11-01T03:19:11.006386+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:19:11.006386+0000","last_undegraded":"2023-11-01T03:19:11.006386+0000","last_fullsized":"2023-11-01T03:19:11.006386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.182543+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:19:11.182543+0000","last_peered":"2023-11-01T03:19:11.182543+0000","last_clean":"2023-11-01T03:19:11.182543+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:19:11.182543+0000","last_undegraded":"2023-11-01T03:19:11.182543+0000","last_fullsized":"2023-11-01T03:19:11.182543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.187124+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:19:11.187124+0000","last_peered":"2023-11-01T03:19:11.187124+0000","last_clean":"2023-11-01T03:19:11.187124+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:19:11.187124+0000","last_undegraded":"2023-11-01T03:19:11.187124+0000","last_fullsized":"2023-11-01T03:19:11.187124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":117,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-01T03:19:11.324758+0000","last_change":"2023-11-01T03:19:01.879653+0000","last_active":"2023-11-01T03:19:11.324758+0000","last_peered":"2023-11-01T03:19:11.324758+0000","last_clean":"2023-11-01T03:19:11.324758+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:19:11.324758+0000","last_undegraded":"2023-11-01T03:19:11.324758+0000","last_fullsized":"2023-11-01T03:19:11.324758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_clean_scrub_stamp":"2023-11-01T03:18:57.938958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:10:19.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.475999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.356}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.745000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.606999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":36.213000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.100999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.347}]}]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":606208,"data_stored":467988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.061999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.097}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.666}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.547999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.096}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.701000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.096}]}]},{"osd":3,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3049999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.583}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":33.353000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.188000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":32.143000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.111000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.013999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1240000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":70.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":66.536000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.823}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.329000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7320000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":606208,"data_stored":467988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8049999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.031000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.301}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.172999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.65}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.297000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.902000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.393000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.382999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.592000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.992999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.946}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3419999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6370000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.215}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.16}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.5099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.847}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.585999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.105}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.951000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.943}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.491}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.590999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8520000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.858000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:19:16.926 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-01T03:19:16.927 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-01T03:19:16.927 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-01T03:19:16.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-01T03:19:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 10 monclient: get_monmap_and_config 2023-11-01T03:19:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 10 monclient: build_initial_monmap 2023-11-01T03:19:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 10 monclient: monmap: 2023-11-01T03:19:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:19:17.031978+0000 2023-11-01T03:19:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:19:17.031978+0000 2023-11-01T03:19:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:19:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:19:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:19:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:19:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:19:17.034 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 1 Processor -- start 2023-11-01T03:19:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 1 -- start start 2023-11-01T03:19:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.031+0000 7f67c7e09640 10 monclient: init 2023-11-01T03:19:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2023-11-01T03:19:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f67c00b4240 addr v1:172.21.15.153:6789/0 2023-11-01T03:19:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f67c00b38d0 addr v1:172.21.15.5:6789/0 2023-11-01T03:19:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 0x7f67c013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-b con 0x7f67c00ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c00b0cc0 con 0x7f67c00b38d0 2023-11-01T03:19:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c013f5f0 con 0x7f67c00b4240 2023-11-01T03:19:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b4620 con 0x7f67c00ade00 2023-11-01T03:19:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.032+0000 7f67c7e09640 10 monclient(hunting): authenticate will time out at 1433.256431s 2023-11-01T03:19:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c53a4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67c00b38d0 0x7f67c00ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41914/0 (socket says 172.21.15.5:41914) 2023-11-01T03:19:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c53a4640 1 -- 172.21.15.5:0/1734826720 learned_addr learned my addr 172.21.15.5:0/1734826720 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c63a6640 1 --2- 172.21.15.5:0/1734826720 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 0x7f67c013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c63a6640 10 monclient(hunting): get_auth_request con 0x7f67c00ade00 auth_method 0 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c63a6640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.033+0000 7f67c63a6640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.034+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.034+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.034+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693518603 0 0) 0x7f67c00b0cc0 con 0x7f67c00b38d0 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _negotiate 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): my global_id is 4359 2023-11-01T03:19:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a8003520 con 0x7f67c00b38d0 2023-11-01T03:19:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497340962 0 0) 0x7f67c013f5f0 con 0x7f67c00b4240 2023-11-01T03:19:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _negotiate 2023-11-01T03:19:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 10 monclient(hunting): my global_id is 4402 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c00b0cc0 con 0x7f67c00b4240 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c63a6640 10 monclient(hunting): handle_auth_done global_id 4334 payload 274 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c63a6640 1 -- 172.21.15.5:0/1734826720 >> v1:172.21.15.153:6789/0 conn(0x7f67c00b4240 legacy=0x7f67c00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.035+0000 7f67c63a6640 1 -- 172.21.15.5:0/1734826720 >> v1:172.21.15.5:6789/0 conn(0x7f67c00b38d0 legacy=0x7f67c00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.036+0000 7f67c63a6640 10 monclient: _finish_hunting 0 2023-11-01T03:19:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.036+0000 7f67c63a6640 1 monclient: found mon.noname-b 2023-11-01T03:19:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.036+0000 7f67c63a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.036+0000 7f67c63a6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:19:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.036+0000 7f67c63a6640 1 -- 172.21.15.5:0/1734826720 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c013b960 con 0x7f67c00ade00 2023-11-01T03:19:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.038+0000 7f67c63a6640 1 --2- 172.21.15.5:0/1734826720 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 0x7f67c013b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009df0 tx=0x7f67b002be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce33441fd6d3d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b002cc20 con 0x7f67c00ade00 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: dump: 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:17.050 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: _finish_auth 0 2023-11-01T03:19:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: _check_auth_tickets 2023-11-01T03:19:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b002cd80 con 0x7f67c00ade00 2023-11-01T03:19:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 1 -- 172.21.15.5:0/1734826720 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0034660 con 0x7f67c00ade00 2023-11-01T03:19:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c7e09640 5 monclient: authenticate success, global_id 4334 2023-11-01T03:19:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c7e09640 10 monclient: get_monmap_and_config success 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c7e09640 4 set_mon_vals no callback set 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.041+0000 7f67c4ba3640 10 monclient: dump: 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:17.054 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 10 monclient: shutdown 2023-11-01T03:19:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:17.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 -- 172.21.15.5:0/1734826720 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 msgr2=0x7f67c013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 --2- 172.21.15.5:0/1734826720 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 0x7f67c013b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009df0 tx=0x7f67b002be70 comp rx=0 tx=0).stop 2023-11-01T03:19:17.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 -- 172.21.15.5:0/1734826720 shutdown_connections 2023-11-01T03:19:17.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 --2- 172.21.15.5:0/1734826720 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c00ade00 0x7f67c013b420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 -- 172.21.15.5:0/1734826720 >> 172.21.15.5:0/1734826720 conn(0x7f67c0065cd0 msgr2=0x7f67c00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 -- 172.21.15.5:0/1734826720 shutdown_connections 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.042+0000 7f67c7e09640 1 -- 172.21.15.5:0/1734826720 wait complete. 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 10 monclient: build_initial_monmap 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 10 monclient: monmap: 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:19:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:19:17.057 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:19:17.057 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:19:17.057 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:19:17.057 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.057 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:19:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:19:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:19:17.058 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 librados: starting msgr at 2023-11-01T03:19:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 librados: starting objecter 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 Processor -- start 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 -- start start 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 librados: setting wanted keys 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 1 librados: calling monclient init 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.043+0000 7f67c7e09640 10 monclient: init 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient: _reopen_session rank -1 2023-11-01T03:19:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-b con 0x7f67c00ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67c00b4240 0x7f67c01392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-a con 0x7f67c00b4240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c0135330 0x7f67c01357e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:17.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): picked mon.noname-c con 0x7f67c0135330 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0138460 con 0x7f67c00b4240 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0136200 con 0x7f67c00ade00 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): start opening mon connection 2023-11-01T03:19:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c013f130 con 0x7f67c0135330 2023-11-01T03:19:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): _renew_subs 2023-11-01T03:19:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c7e09640 10 monclient(hunting): authenticate will time out at 1433.268340s 2023-11-01T03:19:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c63a6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c0135330 0x7f67c01357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c5ba5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:17.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.044+0000 7f67c53a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67c00b4240 0x7f67c01392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:60192/0 (socket says 172.21.15.5:60192) 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 1 -- 172.21.15.5:0/2972273849 learned_addr learned my addr 172.21.15.5:0/2972273849 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): get_auth_request con 0x7f67c00ade00 auth_method 0 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c63a6640 10 monclient(hunting): get_auth_request con 0x7f67c0135330 auth_method 0 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c63a6640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c63a6640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): get_auth_request con 0x7f67c00b4240 auth_method 0 2023-11-01T03:19:17.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:17.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.045+0000 7f67c53a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.046+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:19:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.046+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:19:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.046+0000 7f67c63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:19:17.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 10 monclient(hunting): handle_auth_done global_id 4405 payload 824 2023-11-01T03:19:17.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 -- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c0135330 msgr2=0x7f67c01357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c0135330 0x7f67c01357e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 -- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67c00b4240 msgr2=0x7f67c01392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67c00b4240 0x7f67c01392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 10 monclient: _finish_hunting 0 2023-11-01T03:19:17.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 monclient: found mon.noname-b 2023-11-01T03:19:17.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:19:17.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:19:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.048+0000 7f67c5ba5640 1 -- 172.21.15.5:0/2972273849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0009a70 con 0x7f67c00ade00 2023-11-01T03:19:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.050+0000 7f67c5ba5640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c460 tx=0x7f67b800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.050+0000 7f67be7fc640 10 client.?.objecter ms_handle_connect 0x7f67c00ade00 2023-11-01T03:19:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.050+0000 7f67be7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:19:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80052d0 con 0x7f67c00ade00 2023-11-01T03:19:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:19:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: dump: 2023-11-01T03:19:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:17.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: _finish_auth 0 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:19:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8005450 con 0x7f67c00ade00 2023-11-01T03:19:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:19:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67c7e09640 5 monclient: authenticate success, global_id 4405 2023-11-01T03:19:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8003830 con 0x7f67c00ade00 2023-11-01T03:19:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:19:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:19:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67be7fc640 10 monclient: dump: 2023-11-01T03:19:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:19:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:19:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:19:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:19:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:19:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:19:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:19:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67c7e09640 10 monclient: _renew_subs 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67c7e09640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67bffff640 4 set_mon_vals no callback set 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.054+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c013e4f0 con 0x7f67c00ade00 2023-11-01T03:19:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:19:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 monclient: _renew_subs 2023-11-01T03:19:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c01da0c0 con 0x7f67c00ade00 2023-11-01T03:19:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 1 librados: init done 2023-11-01T03:19:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.055+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c01398d0 con 0x7f67c00ade00 2023-11-01T03:19:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.074+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f67b8003990 con 0x7f67c00ade00 2023-11-01T03:19:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.074+0000 7f67be7fc640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 0x7f67ac06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:19:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.074+0000 7f67c53a4640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 0x7f67ac06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:19:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.074+0000 7f67c53a4640 10 monclient: get_auth_request con 0x7f67ac06c880 auth_method 0 2023-11-01T03:19:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.075+0000 7f67c53a4640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 0x7f67ac06ed40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67c013ff80 tx=0x7f67b4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:19:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.075+0000 7f67be7fc640 10 client.4405.objecter ms_handle_connect 0x7f67ac06c880 2023-11-01T03:19:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.077+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f67b8057bf0 con 0x7f67c00ade00 2023-11-01T03:19:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.077+0000 7f67be7fc640 10 client.4405.objecter ms_dispatch 0x7f67c0000b90 osd_map(21..21 src has 1..21) v4 2023-11-01T03:19:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.077+0000 7f67be7fc640 3 client.4405.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:19:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.077+0000 7f67be7fc640 3 client.4405.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:19:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.077+0000 7f67be7fc640 20 client.4405.objecter dump_active .. 0 homeless 2023-11-01T03:19:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.315+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67b8053f30 con 0x7f67c00ade00 2023-11-01T03:19:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.315+0000 7f67be7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:19:17.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.315+0000 7f67be7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:19:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.550+0000 7f67c7e09640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2023-11-01T03:19:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.550+0000 7f67c7e09640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2023-11-01T03:19:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.550+0000 7f67c7e09640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:19:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.550+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f67c01398d0 con 0x7f67c00ade00 2023-11-01T03:19:17.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.581+0000 7f67be7fc640 1 -- 172.21.15.5:0/2972273849 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f67b8017040 con 0x7f67c00ade00 2023-11-01T03:19:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.581+0000 7f67be7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2023-11-01T03:19:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.581+0000 7f67be7fc640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:19:17.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:19:17.583 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-01T03:19:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 10 librados: watch_flush enter 2023-11-01T03:19:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 10 librados: watch_flush exit 2023-11-01T03:19:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 20 client.4405.objecter shutdown clearing up homeless session... 2023-11-01T03:19:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 10 client.4405.objecter successfully canceled tick 2023-11-01T03:19:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 msgr2=0x7f67ac06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 0x7f67ac06ed40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67c013ff80 tx=0x7f67b4007d30 comp rx=0 tx=0).stop 2023-11-01T03:19:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.583+0000 7f67c7e09640 10 monclient: shutdown 2023-11-01T03:19:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:19:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 msgr2=0x7f67c0138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:19:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c460 tx=0x7f67b800c920 comp rx=0 tx=0).stop 2023-11-01T03:19:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 shutdown_connections 2023-11-01T03:19:17.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f67ac06c880 0x7f67ac06ed40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f67c0135330 0x7f67c01357e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67c00b4240 0x7f67c01392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 --2- 172.21.15.5:0/2972273849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67c00ade00 0x7f67c0138d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 >> 172.21.15.5:0/2972273849 conn(0x7f67c0065cd0 msgr2=0x7f67c00660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 shutdown_connections 2023-11-01T03:19:17.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 -- 172.21.15.5:0/2972273849 wait complete. 2023-11-01T03:19:17.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:19:17.584+0000 7f67c7e09640 1 librados: shutdown 2023-11-01T03:19:17.595 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-01T03:19:17.595 INFO:teuthology.run_tasks:Running task workunit... 2023-11-01T03:19:17.609 INFO:tasks.workunit:Pulling workunits from ref 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:19:17.609 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-01T03:19:17.609 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-01T03:19:17.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-01T03:19:17.625 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-01T03:19:17.680 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-01T03:19:17.680 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-01T03:19:17.736 INFO:tasks.workunit:timeout=6h 2023-11-01T03:19:17.736 INFO:tasks.workunit:cleanup=True 2023-11-01T03:19:17.736 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-01T03:19:17.792 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-01T03:19:28.903 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:30.212 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.908 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:30.217 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.954 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:30.264 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.959 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:30.231 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.962 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:30.233 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.965 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:30.274 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:28.973 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:30.283 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:29.004 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:30.275 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:29.016 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:30.326 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.000 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:50.309 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.005 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:50.315 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.029 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:01:50.339 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.053 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:50.324 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.058 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:50.329 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.074 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:01:50.345 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.090 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:50.399 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.095 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:50.405 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:19:49.125 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:01:50.435 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:05.309 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 99% (11563/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-11-01T03:20:05.985 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '420cd129397301b1521ceb74e1bdbd9b855d2189'. 2023-11-01T03:20:05.986 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.986 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-01T03:20:05.986 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-01T03:20:05.986 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2023-11-01T03:20:05.987 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.987 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-01T03:20:05.987 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-01T03:20:05.987 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.987 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.988 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-01T03:20:05.989 INFO:tasks.workunit.client.0.smithi005.stderr: 2023-11-01T03:20:05.989 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 420cd129397 Added pg-id debug info to help track which pg is being processed 2023-11-01T03:20:05.990 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-01T03:20:06.061 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-01T03:20:06.063 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-01T03:20:06.063 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-01T03:20:06.696 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-01T03:20:06.770 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-01T03:20:06.811 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-01T03:20:06.812 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-01T03:20:06.812 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-01T03:20:06.854 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-01T03:20:06.855 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-11-01T03:20:06.855 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-01T03:20:06.911 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-11-01T03:20:06.912 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-11-01T03:20:06.912 DEBUG:teuthology.orchestra.run.smithi005:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=420cd129397301b1521ceb74e1bdbd9b855d2189 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-11-01T03:20:06.970 INFO:tasks.workunit.client.0.smithi005.stderr:+ parallel=1 2023-11-01T03:20:06.971 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' '' = --serial ']' 2023-11-01T03:20:06.971 INFO:tasks.workunit.client.0.smithi005.stderr:+ color= 2023-11-01T03:20:06.971 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -t 1 ']' 2023-11-01T03:20:06.971 INFO:tasks.workunit.client.0.smithi005.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-11-01T03:20:06.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ declare -A pids 2023-11-01T03:20:06.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:06.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:06.972 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_aio 2023-11-01T03:20:06.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_aio' 2023-11-01T03:20:06.973 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_aio 2023-11-01T03:20:06.973 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:06.974 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_aio 2023-11-01T03:20:06.974 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91551 2023-11-01T03:20:06.974 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_aio on pid 91551' 2023-11-01T03:20:06.975 INFO:tasks.workunit.client.0.smithi005.stdout:test api_aio on pid 91551 2023-11-01T03:20:06.977 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91551 2023-11-01T03:20:06.977 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:06.978 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:06.978 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-11-01T03:20:06.978 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_aio_pp 2023-11-01T03:20:06.978 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_aio_pp' 2023-11-01T03:20:06.979 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_aio_pp 2023-11-01T03:20:06.979 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:06.979 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:06.979 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:06.979 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:06.980 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:06.981 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.981 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:06.981 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.981 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:06.981 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:06.982 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.982 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:06.982 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.982 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:06.982 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:06.983 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:06.984 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_aio_pp 2023-11-01T03:20:06.984 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91558 2023-11-01T03:20:06.984 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_aio_pp on pid 91558' 2023-11-01T03:20:06.984 INFO:tasks.workunit.client.0.smithi005.stdout:test api_aio_pp on pid 91558 2023-11-01T03:20:06.988 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91558 2023-11-01T03:20:06.988 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:06.988 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:06.988 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-11-01T03:20:06.989 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_io 2023-11-01T03:20:06.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_io' 2023-11-01T03:20:06.989 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_io 2023-11-01T03:20:06.989 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:06.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:06.990 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:06.990 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:06.990 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:06.990 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.990 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:06.991 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.992 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:06.992 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:06.992 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.992 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:06.992 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:06.993 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:06.994 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.994 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:06.994 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.994 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.994 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:06.995 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:06.996 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:06.997 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:06.997 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:06.997 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:06.997 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:06.997 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:06.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_io 2023-11-01T03:20:06.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91567 2023-11-01T03:20:06.998 INFO:tasks.workunit.client.0.smithi005.stdout:test api_io on pid 91567 2023-11-01T03:20:07.001 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_io on pid 91567' 2023-11-01T03:20:07.001 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91567 2023-11-01T03:20:07.002 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-11-01T03:20:07.002 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.002 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.002 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_io_pp 2023-11-01T03:20:07.002 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_io_pp' 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_io_pp 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.003 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.004 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.004 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.004 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.004 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.004 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.005 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.006 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.007 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.007 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.007 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.007 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.007 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.008 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.009 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.010 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.010 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.010 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.010 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.011 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.012 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.013 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_io_pp 2023-11-01T03:20:07.013 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91578 2023-11-01T03:20:07.013 INFO:tasks.workunit.client.0.smithi005.stdout:test api_io_pp on pid 91578 2023-11-01T03:20:07.017 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_io_pp on pid 91578' 2023-11-01T03:20:07.017 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91578 2023-11-01T03:20:07.018 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.018 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.018 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-11-01T03:20:07.018 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_asio 2023-11-01T03:20:07.018 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_asio' 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_asio 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.019 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.020 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.021 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.022 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.023 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.023 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.023 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.023 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.023 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.024 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.025 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.026 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.027 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.028 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.029 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.029 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.029 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.029 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.029 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.030 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.030 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.030 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.030 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.030 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.031 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.032 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_asio 2023-11-01T03:20:07.032 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91592 2023-11-01T03:20:07.032 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_asio on pid 91592' 2023-11-01T03:20:07.032 INFO:tasks.workunit.client.0.smithi005.stdout:test api_asio on pid 91592 2023-11-01T03:20:07.038 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91592 2023-11-01T03:20:07.038 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.038 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-11-01T03:20:07.039 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_list 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_list' 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_list 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.040 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.041 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.042 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.043 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.045 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.046 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.047 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.048 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.051 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.051 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.051 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.051 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.051 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.052 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.053 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.054 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91551/exe 2023-11-01T03:20:07.055 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.056 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.056 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.056 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.056 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.056 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.057 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.058 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_list 2023-11-01T03:20:07.058 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.058 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.058 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.058 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91613 2023-11-01T03:20:07.059 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.059 INFO:tasks.workunit.client.0.smithi005.stdout:test api_list on pid 91613 2023-11-01T03:20:07.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_list on pid 91613' 2023-11-01T03:20:07.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91613 2023-11-01T03:20:07.066 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.066 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.066 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-11-01T03:20:07.066 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.066 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_lock 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.067 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.068 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_lock' 2023-11-01T03:20:07.068 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_aio 2023-11-01T03:20:07.068 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_aio.log 2023-11-01T03:20:07.068 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_aio: /' 2023-11-01T03:20:07.068 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_lock 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.069 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.070 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.070 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.070 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.070 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.070 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.072 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.073 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.074 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.074 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.074 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.074 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.074 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.075 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.076 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.077 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.078 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.078 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.078 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.078 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.078 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.079 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.080 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.081 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.081 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.081 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.081 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.081 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.082 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.083 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.083 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.083 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91558/exe 2023-11-01T03:20:07.083 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.083 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.084 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.085 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_lock 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91632 2023-11-01T03:20:07.086 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.087 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.087 INFO:tasks.workunit.client.0.smithi005.stdout:test api_lock on pid 91632 2023-11-01T03:20:07.098 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_lock on pid 91632' 2023-11-01T03:20:07.098 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91632 2023-11-01T03:20:07.098 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.098 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.099 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.100 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.100 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.100 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.100 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.100 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_lock_pp 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.101 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.102 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.102 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.102 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.102 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.102 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.103 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.103 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.103 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.103 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.103 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_lock_pp' 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.104 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.105 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.106 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-11-01T03:20:07.107 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_aio_pp: /' 2023-11-01T03:20:07.108 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.109 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.110 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.110 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_aio_pp 2023-11-01T03:20:07.110 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.110 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.110 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.111 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.112 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.112 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.112 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.112 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.112 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.113 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91567/exe 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.114 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.115 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.116 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.117 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.117 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.117 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.117 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.117 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.118 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.119 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.119 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.119 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.119 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.119 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.120 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.121 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.122 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.122 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.122 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.122 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.122 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.123 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.124 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.125 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.126 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.126 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.126 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.126 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.126 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.127 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.127 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.127 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.127 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.127 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_io 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_io: /' 2023-11-01T03:20:07.128 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_io.log 2023-11-01T03:20:07.129 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.129 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.129 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.129 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.129 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.130 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.130 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.130 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.130 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.130 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.131 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.132 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.132 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.132 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.132 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.132 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_lock_pp 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91578/exe 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.133 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.134 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.134 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.134 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.134 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.134 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.135 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.135 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.135 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.135 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.135 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.136 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_lock_pp 2023-11-01T03:20:07.136 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91663 2023-11-01T03:20:07.136 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_lock_pp on pid 91663' 2023-11-01T03:20:07.136 INFO:tasks.workunit.client.0.smithi005.stdout:test api_lock_pp on pid 91663 2023-11-01T03:20:07.143 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91663 2023-11-01T03:20:07.143 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.144 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.144 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.144 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-11-01T03:20:07.144 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.144 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.145 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.146 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.146 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.146 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.146 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.146 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_misc 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.147 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.148 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.148 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_misc' 2023-11-01T03:20:07.148 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.148 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.148 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.149 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.150 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.151 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.151 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.151 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.151 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.151 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_io_pp 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.152 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.153 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.153 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.153 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.153 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.153 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.154 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.154 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.154 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.154 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.154 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.155 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.156 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.156 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.156 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.156 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.156 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.157 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.158 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.158 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.158 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.158 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.158 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_io_pp: /' 2023-11-01T03:20:07.159 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.159 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.159 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.159 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.159 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.160 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_misc 2023-11-01T03:20:07.160 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.160 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.160 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.160 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.161 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_misc 2023-11-01T03:20:07.161 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91681 2023-11-01T03:20:07.161 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_misc on pid 91681' 2023-11-01T03:20:07.161 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91592/exe 2023-11-01T03:20:07.161 INFO:tasks.workunit.client.0.smithi005.stdout:test api_misc on pid 91681 2023-11-01T03:20:07.176 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91681 2023-11-01T03:20:07.177 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.177 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.177 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-11-01T03:20:07.177 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.177 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.178 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.178 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_misc_pp 2023-11-01T03:20:07.178 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.178 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.178 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_misc_pp' 2023-11-01T03:20:07.179 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.179 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.179 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.179 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.179 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.180 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.181 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.181 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.181 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.181 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.181 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.182 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.183 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.184 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.184 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.184 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.184 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.184 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.185 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.186 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.186 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.186 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.186 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.186 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.187 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.188 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_asio.log 2023-11-01T03:20:07.189 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_asio 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_misc_pp 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.190 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.191 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.191 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.191 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.191 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.191 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.192 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.193 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.193 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.193 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.193 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.193 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.194 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.194 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.194 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.194 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.194 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.195 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.195 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.195 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.195 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.195 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.196 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.196 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.196 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.196 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.196 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.197 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.198 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.198 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.198 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.198 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.198 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.199 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.200 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.201 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91632/exe 2023-11-01T03:20:07.202 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.202 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.202 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.202 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.202 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91613/exe 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.203 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.204 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.204 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.204 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.204 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.204 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.205 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.205 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.205 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.205 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_asio: /' 2023-11-01T03:20:07.205 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.206 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.206 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.206 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.206 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.206 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.207 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_list 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.208 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.209 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.210 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.210 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.210 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_lock: /' 2023-11-01T03:20:07.210 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.210 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.211 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.212 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.212 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_list: /' 2023-11-01T03:20:07.212 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_misc_pp 2023-11-01T03:20:07.212 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91713 2023-11-01T03:20:07.213 INFO:tasks.workunit.client.0.smithi005.stdout:test api_misc_pp on pid 91713 2023-11-01T03:20:07.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_misc_pp on pid 91713' 2023-11-01T03:20:07.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91713 2023-11-01T03:20:07.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.222 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-11-01T03:20:07.223 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.223 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.223 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.223 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.223 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.224 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.224 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.224 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.224 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_tier_pp 2023-11-01T03:20:07.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_tier_pp' 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.225 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.226 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_tier_pp 2023-11-01T03:20:07.226 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.226 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.226 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.226 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.227 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.227 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.227 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.227 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.227 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.228 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.228 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.228 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.228 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.228 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.229 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.230 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.230 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.230 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.230 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.230 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.231 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.232 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.233 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.233 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.233 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.233 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.233 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.234 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.234 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.234 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_lock.log 2023-11-01T03:20:07.234 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_list.log 2023-11-01T03:20:07.234 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.235 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.236 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.236 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.236 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.236 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.236 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.237 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.238 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.238 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.238 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.238 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.238 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.239 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.239 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.239 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.239 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.239 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.240 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.241 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.242 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.242 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.242 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.242 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.242 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.243 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.244 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.245 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.245 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.245 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91681/exe 2023-11-01T03:20:07.245 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_lock 2023-11-01T03:20:07.245 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_tier_pp 2023-11-01T03:20:07.246 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91739 2023-11-01T03:20:07.246 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_tier_pp on pid 91739' 2023-11-01T03:20:07.246 INFO:tasks.workunit.client.0.smithi005.stdout:test api_tier_pp on pid 91739 2023-11-01T03:20:07.257 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91739 2023-11-01T03:20:07.258 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.258 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-11-01T03:20:07.258 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.258 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.258 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.259 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.259 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.259 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.259 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.259 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.260 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.260 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.260 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.260 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.260 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.261 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.261 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.261 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.261 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.261 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.262 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.262 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.262 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.262 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.262 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.263 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.264 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.264 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.264 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.264 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.264 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.265 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.265 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.265 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.265 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.265 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.266 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.266 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.266 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.266 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.266 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.267 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.268 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.268 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.268 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.268 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.268 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.269 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.270 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.270 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.270 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.270 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_misc 2023-11-01T03:20:07.270 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_misc: /' 2023-11-01T03:20:07.271 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.271 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.271 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.271 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.271 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.272 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.273 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.273 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.273 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.273 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.273 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.274 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.274 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.274 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.274 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.274 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.275 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.275 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.275 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.275 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.275 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_pool 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_pool' 2023-11-01T03:20:07.276 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91663/exe 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_pool 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.277 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.278 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.278 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.278 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.278 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.278 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_lock_pp 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.279 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.280 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.281 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.282 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_pool 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.283 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.284 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.284 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91787 2023-11-01T03:20:07.284 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_pool on pid 91787' 2023-11-01T03:20:07.284 INFO:tasks.workunit.client.0.smithi005.stdout:test api_pool on pid 91787 2023-11-01T03:20:07.286 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91787 2023-11-01T03:20:07.286 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-11-01T03:20:07.287 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.287 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.287 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_snapshots 2023-11-01T03:20:07.287 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_snapshots' 2023-11-01T03:20:07.287 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_snapshots 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.288 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.289 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.289 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_misc.log 2023-11-01T03:20:07.289 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_lock_pp: /' 2023-11-01T03:20:07.289 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_snapshots 2023-11-01T03:20:07.289 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91794 2023-11-01T03:20:07.290 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_snapshots on pid 91794' 2023-11-01T03:20:07.290 INFO:tasks.workunit.client.0.smithi005.stdout:test api_snapshots on pid 91794 2023-11-01T03:20:07.301 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91794 2023-11-01T03:20:07.302 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.302 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.302 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-11-01T03:20:07.302 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_snapshots_pp 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_snapshots_pp' 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_snapshots_pp 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.303 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.304 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.305 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.306 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.306 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.306 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.306 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.306 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.307 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.308 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.309 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.310 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.310 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.310 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.310 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.310 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.311 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.312 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.312 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.312 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.312 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.312 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.313 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.314 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.315 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.316 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.317 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.318 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.318 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.318 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.318 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.318 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.319 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.320 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91713/exe 2023-11-01T03:20:07.321 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.322 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.322 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.322 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.322 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.322 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.323 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.324 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.325 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.326 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.326 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.326 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.326 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.326 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_snapshots_pp 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.327 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91827 2023-11-01T03:20:07.328 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_snapshots_pp on pid 91827' 2023-11-01T03:20:07.328 INFO:tasks.workunit.client.0.smithi005.stdout:test api_snapshots_pp on pid 91827 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91827 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.333 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_misc_pp 2023-11-01T03:20:07.334 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.334 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.334 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.334 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.334 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_misc_pp: /' 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.335 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.336 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.337 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.338 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.338 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.338 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.338 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.338 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_stat 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_stat' 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.340 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.341 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_stat 2023-11-01T03:20:07.342 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_stat 2023-11-01T03:20:07.342 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91859 2023-11-01T03:20:07.342 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_stat on pid 91859' 2023-11-01T03:20:07.342 INFO:tasks.workunit.client.0.smithi005.stdout:test api_stat on pid 91859 2023-11-01T03:20:07.349 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91859 2023-11-01T03:20:07.349 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.349 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.349 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_stat_pp 2023-11-01T03:20:07.350 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_stat_pp' 2023-11-01T03:20:07.350 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-11-01T03:20:07.350 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.350 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.350 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.351 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.352 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.352 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.352 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.352 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.352 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.353 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.354 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.355 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.356 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.357 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.357 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.357 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.357 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.357 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.358 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.359 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.360 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.361 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.361 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.361 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.361 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.361 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.362 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.362 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.362 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.362 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.362 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_stat_pp 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.363 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.364 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_stat_pp 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91885 2023-11-01T03:20:07.365 INFO:tasks.workunit.client.0.smithi005.stdout:test api_stat_pp on pid 91885 2023-11-01T03:20:07.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_stat_pp on pid 91885' 2023-11-01T03:20:07.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91885 2023-11-01T03:20:07.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.373 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.373 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.373 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.373 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-11-01T03:20:07.373 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.374 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91739/exe 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.375 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_watch_notify 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_watch_notify' 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.376 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.377 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.378 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.378 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.378 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.378 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_watch_notify 2023-11-01T03:20:07.378 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.379 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.380 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.381 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.382 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.382 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.382 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.382 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_tier_pp: /' 2023-11-01T03:20:07.382 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.383 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.384 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.385 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.386 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.386 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.386 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.386 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.386 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_tier_pp 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.387 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.388 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.389 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_watch_notify 2023-11-01T03:20:07.389 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.389 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91931 2023-11-01T03:20:07.389 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_watch_notify on pid 91931' 2023-11-01T03:20:07.389 INFO:tasks.workunit.client.0.smithi005.stdout:test api_watch_notify on pid 91931 2023-11-01T03:20:07.390 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91931 2023-11-01T03:20:07.390 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.390 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-11-01T03:20:07.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [----------] Global test environment set-up. 2023-11-01T03:20:07.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [----------] 12 tests from AsioRados 2023-11-01T03:20:07.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.106+0000 7f63995da780 10 monclient: get_monmap_and_config 2023-11-01T03:20:07.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.106+0000 7f63995da780 10 monclient: build_initial_monmap 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.106+0000 7f63995da780 10 monclient: monmap: 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 0 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 0.000000 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 0.000000 2023-11-01T03:20:07.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 0 (unknown) 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 1 Processor -- start 2023-11-01T03:20:07.394 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 1 -- start start 2023-11-01T03:20:07.394 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 10 monclient: init 2023-11-01T03:20:07.394 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 10 monclient: _reopen_session rank -1 2023-11-01T03:20:07.394 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:20:07.394 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58809410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.107+0000 7f63995da780 10 monclient(hunting): picked mon.noname-a con 0x7f6380002260 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f58808c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): picked mon.noname-c con 0x564f58808730 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f587820c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): picked mon.noname-b con 0x564f5880a7b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:20:07.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f586f92e0 con 0x7f6380002260 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f586944f0 con 0x564f5880a7b0 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f58694190 con 0x564f58808730 2023-11-01T03:20:07.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): _renew_subs 2023-11-01T03:20:07.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.108+0000 7f63995da780 10 monclient(hunting): authenticate will time out at 1483.332040s 2023-11-01T03:20:07.406 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.406 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.407 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.408 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.409 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.410 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.410 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.410 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.410 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.410 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91794/exe 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.411 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.412 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.413 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.414 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.415 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.415 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.415 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.415 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.415 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.416 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.417 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.418 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.418 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.418 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.418 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.418 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.419 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.420 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.421 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.422 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.423 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.423 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.423 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.423 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.423 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.424 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.425 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.426 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_snapshots 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.427 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_snapshots: /' 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.428 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.429 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_watch_notify_pp 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.430 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-11-01T03:20:07.431 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_watch_notify_pp' 2023-11-01T03:20:07.431 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.431 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.431 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.431 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.432 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.433 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.433 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.433 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.433 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.433 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91787/exe 2023-11-01T03:20:07.434 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.110+0000 7f63968dd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f58808c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.434 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f58808c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:45842/0 (socket says 172.21.15.5:45842) 2023-11-01T03:20:07.434 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 1 -- 172.21.15.5:0/3881660356 learned_addr learned my addr 172.21.15.5:0/3881660356 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:20:07.434 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 10 monclient(hunting): get_auth_request con 0x564f58808730 auth_method 0 2023-11-01T03:20:07.434 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.111+0000 7f63968dd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.116+0000 7f63970de640 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58809410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.116+0000 7f63970de640 10 monclient(hunting): get_auth_request con 0x7f6380002260 auth_method 0 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.116+0000 7f63970de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:20:07.435 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.116+0000 7f63970de640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.116+0000 7f63970de640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.117+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.117+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.117+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.118+0000 7f63968dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:20:07.436 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.118+0000 7f63968dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:20:07.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.118+0000 7f63968dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:20:07.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2023-11-01T03:20:07.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 -- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 msgr2=0x564f58808c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:20:07.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f58808c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 -- 172.21.15.5:0/3881660356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 msgr2=0x564f587820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:20:07.439 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.439 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.439 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_watch_notify_pp 2023-11-01T03:20:07.439 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.440 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_pool: /' 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_watch_notify_pp 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91967 2023-11-01T03:20:07.441 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_watch_notify_pp on pid 91967' 2023-11-01T03:20:07.442 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f587820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 revtest api_watch_notify_pp on pid 91967 2023-11-01T03:20:07.447 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=91967 2023-11-01T03:20:07.447 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.447 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_pool.log 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.448 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.449 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_pool 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.450 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.451 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.452 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.452 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.452 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.452 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.452 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.453 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.454 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.455 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.456 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.457 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.458 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.459 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.459 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.459 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.459 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.459 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.460 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.461 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.461 INFO:tasks.workunit.client.0.smithi005.stdout:1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.461 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 10 monclient: _finish_hunting 0 2023-11-01T03:20:07.461 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 monclient: found mon.noname-a 2023-11-01T03:20:07.461 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.120+0000 7f63970de640 1 -- 172.21.15.5:0/3881660356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f58693920 con 0x7f6380002260 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.124+0000 7f63970de640 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58809410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f638c053000 tx=0x7f638c04f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e302d7b0133523de server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 1 -- 172.21.15.5:0/3881660356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c055410 con 0x7f6380002260 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:20:07.462 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: dump: 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 1 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.463 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 18 (reef) 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.464 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: _finish_auth 0 2023-11-01T03:20:07.465 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: _check_auth_tickets 2023-11-01T03:20:07.465 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:07.465 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 1 -- 172.21.15.5:0/3881660356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c055570 con 0x7f6380002260 2023-11-01T03:20:07.465 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:20:07.465 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 1 -- 172.21.15.5:0/3881660356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c055b40 con 0x7f6380002260 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63958db640 10 monclient: dump: 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 1 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:07.466 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.467 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.467 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 18 (reef) 2023-11-01T03:20:07.467 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.467 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:20:07.467 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:20:07.470 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.470 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.470 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.471 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.471 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.471 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.471 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.471 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.472 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.473 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.474 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.474 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.474 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.474 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.474 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.475 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.475 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.475 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.475 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.475 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.476 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.477 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:20:07.477 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.477 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63995da780 5 monclient: authenticate success, global_id 4389 2023-11-01T03:20:07.477 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63995da780 10 monclient: get_monmap_and_config success 2023-11-01T03:20:07.477 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.129+0000 7f63995da780 4 set_mon_vals no callback set 2023-11-01T03:20:07.478 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 10 monclient: shutdown 2023-11-01T03:20:07.478 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:20:07.478 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 -- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 msgr2=0x564f58809410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:07.478 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58809410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f638c053000 tx=0x7f638c04f070 comp rx=0 tx=0).stop 2023-11-01T03:20:07.478 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 -- 172.21.15.5:0/3881660356 shutdown_connections 2023-11-01T03:20:07.479 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f587820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.479 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f58808c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.479 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 --2- 172.21.15.5:0/3881660356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58809410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.479 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 -- 172.21.15.5:0/3881660356 >> 172.21.15.5:0/3881660356 conn(0x564f58782a80 msgr2=0x564f5877e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:20:07.479 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 -- 172.21.15.5:0/3881660356 shutdown_connections 2023-11-01T03:20:07.480 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 1 -- 172.21.15.5:0/3881660356 wait complete. 2023-11-01T03:20:07.480 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 10 monclient: build_initial_monmap 2023-11-01T03:20:07.480 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.130+0000 7f63995da780 10 monclient: monmap: 2023-11-01T03:20:07.480 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 0 2023-11-01T03:20:07.480 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 0.000000 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 0.000000 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 0 (unknown) 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:20:07.481 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:20:07.482 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:20:07.482 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.482 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 librados: starting msgr at 2023-11-01T03:20:07.482 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 librados: starting objecter 2023-11-01T03:20:07.482 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 Processor -- start 2023-11-01T03:20:07.483 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 -- start start 2023-11-01T03:20:07.483 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 librados: setting wanted keys 2023-11-01T03:20:07.483 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 1 librados: calling monclient init 2023-11-01T03:20:07.483 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.131+0000 7f63995da780 10 monclient: init 2023-11-01T03:20:07.483 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient: _reopen_session rank -1 2023-11-01T03:20:07.492 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.493 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.493 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.493 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.493 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.493 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.494 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_cmd 2023-11-01T03:20:07.494 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.494 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.494 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.494 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_cmd' 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.495 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.496 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.497 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.498 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.498 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.498 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.498 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.498 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91827/exe 2023-11-01T03:20:07.499 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.500 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.500 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.500 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.500 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.500 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.501 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.502 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.503 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.504 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.504 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.504 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.504 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.504 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.505 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.506 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.506 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.506 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.506 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_cmd 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.507 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.508 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.509 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.509 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.509 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.509 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.509 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.510 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.510 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.510 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.510 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.510 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.511 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.512 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.512 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.512 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.512 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.512 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.513 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.513 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-11-01T03:20:07.513 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.513 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.513 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.514 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.515 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.515 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.515 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.515 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.515 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.516 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.516 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.516 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_snapshots_pp 2023-11-01T03:20:07.516 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.516 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91885/exe 2023-11-01T03:20:07.517 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_cmd 2023-11-01T03:20:07.517 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-11-01T03:20:07.517 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92015 2023-11-01T03:20:07.517 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_cmd on pid 92015' 2023-11-01T03:20:07.517 INFO:tasks.workunit.client.0.smithi005.stdout: test api_cmd on pid 92015 2023-11-01T03:20:07.521 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92015 2023-11-01T03:20:07.521 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.521 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.521 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.522 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91859/exe 2023-11-01T03:20:07.522 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.522 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.522 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.522 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.523 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.523 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.523 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.523 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.523 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.524 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.524 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.524 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_cmd_pp 2023-11-01T03:20:07.524 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_cmd_pp' 2023-11-01T03:20:07.524 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.525 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_stat_pp 2023-11-01T03:20:07.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.527 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.527 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.527 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.528 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.528 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_stat_pp: /' 2023-11-01T03:20:07.528 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-11-01T03:20:07.528 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_stat: /' 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f588a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): picked mon.noname-c con 0x564f58808730 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f58807460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): picked mon.noname-b con 0x564f5880a7b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:20:07.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58897c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): picked mon.noname-a con 0x7f6380002260 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:20:07.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f586744e0 con 0x7f6380002260 2023-11-01T03:20:07.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f58897820 con 0x564f5880a7b0 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): start opening mon connection 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f588956c0 con 0x564f58808730 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): _renew_subs 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.132+0000 7f63995da780 10 monclient(hunting): authenticate will time out at 1483.356559s 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.158+0000 7f63968dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f58807460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63970de640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f588a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f58807460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:41566/0 (socket says 172.21.15.5:41566) 2023-11-01T03:20:07.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 1 -- 172.21.15.5:0/1412679441 learned_addr learned my addr 172.21.15.5:0/1412679441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:20:07.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 10 monclient(hunting): get_auth_request con 0x564f5880a7b0 auth_method 0 2023-11-01T03:20:07.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:20:07.535 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_stat.log 2023-11-01T03:20:07.535 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_stat 2023-11-01T03:20:07.535 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_cmd_pp 2023-11-01T03:20:07.535 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.535 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.536 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.537 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.538 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.538 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.538 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.538 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.538 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.539 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.539 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.539 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.539 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.539 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.540 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.541 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.541 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.541 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.541 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.541 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.542 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.542 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:20:07.542 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.162+0000 7f63968dd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:20:07.542 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): get_auth_request con 0x564f58808730 auth_method 0 2023-11-01T03:20:07.543 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:20:07.543 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:20:07.543 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:20:07.543 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:20:07.543 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:20:07.544 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.164+0000 7f63970de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:20:07.544 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.168+0000 7f63978df640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58897c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.544 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.168+0000 7f63978df640 10 monclient(hunting): get_auth_request con 0x7f6380002260 auth_method 0 2023-11-01T03:20:07.544 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.168+0000 7f63978df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:20:07.544 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.168+0000 7f63978df640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.168+0000 7f63978df640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63978df640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63978df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63978df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 10 monclient(hunting): handle_auth_done global_id 4364 payload 824 2023-11-01T03:20:07.545 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 -- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 msgr2=0x564f58807460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:07.546 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f5880a7b0 0x564f58807460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.546 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 -- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 msgr2=0x564f58897c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:07.546 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6380002260 0x564f58897c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:07.546 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 10 monclient: _finish_hunting 0 2023-11-01T03:20:07.547 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 monclient: found mon.noname-c 2023-11-01T03:20:07.547 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:20:07.547 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:20:07.552 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.552 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.552 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.553 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.553 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.553 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.553 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.553 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.554 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.554 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.554 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.554 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.554 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.555 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.555 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.555 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.555 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.555 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.556 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.557 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.557 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.557 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.557 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.557 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.558 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.558 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.558 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.558 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.558 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.559 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.560 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.560 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.560 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.560 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.560 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91931/exe 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.561 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.562 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.562 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.562 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.562 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.562 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_watch_notify 2023-11-01T03:20:07.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_cmd_pp 2023-11-01T03:20:07.564 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92050 2023-11-01T03:20:07.564 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_cmd_pp on pid 92050' 2023-11-01T03:20:07.564 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.169+0000 7f63970de640 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_test api_cmd_pp on pid 92050 2023-11-01T03:20:07.571 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92050 2023-11-01T03:20:07.571 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.571 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.571 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.572 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.572 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.572 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.572 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.572 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.573 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-11-01T03:20:07.573 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.573 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.573 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.573 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.574 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.575 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.575 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.575 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.575 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.575 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.576 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.576 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.576 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.576 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.576 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.577 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.577 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.577 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.577 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.577 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.578 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/91967/exe 2023-11-01T03:20:07.579 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-11-01T03:20:07.579 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.579 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.579 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.579 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_watch_notify: /' 2023-11-01T03:20:07.580 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.580 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.580 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.580 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.580 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_service 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.581 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.582 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.582 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_service' 2023-11-01T03:20:07.582 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.582 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.583 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.584 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.585 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.585 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.585 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.585 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.585 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.586 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.586 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.586 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.586 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_service 2023-11-01T03:20:07.586 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.587 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_service 2023-11-01T03:20:07.587 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92082 2023-11-01T03:20:07.587 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_service on pid 92082' 2023-11-01T03:20:07.587 INFO:tasks.workunit.client.0.smithi005.stdout:test api_service on pid 92082 2023-11-01T03:20:07.597 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92082 2023-11-01T03:20:07.597 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.597 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.598 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_service_pp 2023-11-01T03:20:07.598 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_service_pp' 2023-11-01T03:20:07.598 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_service_pp 2023-11-01T03:20:07.598 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-11-01T03:20:07.598 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.599 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.600 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.600 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.600 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.600 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.600 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.601 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.601 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.601 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.601 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.601 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.602 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.602 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.602 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.602 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.602 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.603 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.603 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.603 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.603 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.603 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.604 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.604 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.604 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.604 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.604 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.605 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.606 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.606 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.606 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.606 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_watch_notify_pp 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.607 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-11-01T03:20:07.608 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.608 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.608 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.608 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-11-01T03:20:07.608 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.609 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.609 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.609 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.609 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.609 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.610 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.610 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.610 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.610 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.610 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.611 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.612 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.612 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.612 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.612 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.612 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.613 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.614 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.614 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.614 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.614 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.614 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.615 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.615 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.615 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.615 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.615 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.616 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.617 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.617 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.617 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.617 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.617 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.618 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.619 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.619 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.619 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.619 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.619 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.620 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.620 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.620 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.620 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.620 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.621 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.621 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.621 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.621 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.621 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.622 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.623 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.623 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.623 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.623 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.623 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.624 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.625 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.625 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.625 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92015/exe 2023-11-01T03:20:07.625 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_service_pp 2023-11-01T03:20:07.625 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92127 2023-11-01T03:20:07.626 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_service_pp on pid 92127' 2023-11-01T03:20:07.626 INFO:tasks.workunit.client.0.smithi005.stdout:test api_service_pp on pid 92127 2023-11-01T03:20:07.629 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92127 2023-11-01T03:20:07.630 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-11-01T03:20:07.630 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.630 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.630 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.630 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.631 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.631 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.631 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.631 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_c_write_operations 2023-11-01T03:20:07.631 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_c_write_operations' 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.632 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_c_write_operations 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.633 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.634 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.635 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.635 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.635 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.635 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.635 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.636 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.636 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.636 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.636 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.636 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_cmd.log 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_cmd 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_c_write_operations 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92143 2023-11-01T03:20:07.637 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_cmd: /' 2023-11-01T03:20:07.638 INFO:tasks.workunit.client.0.smithi005.stdout:test api_c_write_operations on pid 92143 2023-11-01T03:20:07.644 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_c_write_operations on pid 92143' 2023-11-01T03:20:07.644 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92143 2023-11-01T03:20:07.644 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.644 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.644 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_c_read_operations 2023-11-01T03:20:07.645 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.645 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_c_read_operations' 2023-11-01T03:20:07.645 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.645 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.645 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.646 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.646 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.646 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.646 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.646 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.647 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.647 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.647 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.647 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.647 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.648 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.649 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.649 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.649 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.649 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.649 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.650 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.650 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.650 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.650 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.650 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.651 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.652 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_c_read_operations 2023-11-01T03:20:07.652 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.652 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.652 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.652 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.653 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.654 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.655 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92050/exe 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.656 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.657 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.657 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.657 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.657 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.657 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.658 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.659 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.659 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.659 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.659 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_c_read_operations 2023-11-01T03:20:07.659 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92167 2023-11-01T03:20:07.660 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_c_read_operations on pid 92167' 2023-11-01T03:20:07.660 INFO:tasks.workunit.client.0.smithi005.stdout:test api_c_read_operations on pid 92167 2023-11-01T03:20:07.670 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92167 2023-11-01T03:20:07.670 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.670 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.670 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-11-01T03:20:07.670 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.671 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.672 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.672 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.672 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.672 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.672 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.673 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.674 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_cmd_pp 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.675 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.676 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.677 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.677 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.677 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.677 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.677 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s api_cls_remote_reads 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.678 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.679 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.679 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.679 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' api_cls_remote_reads' 2023-11-01T03:20:07.679 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.679 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo api_cls_remote_reads 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.680 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.681 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.682 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.683 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.684 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.685 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.686 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.686 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.686 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.686 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.686 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92082/exe 2023-11-01T03:20:07.687 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.688 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.689 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.690 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.691 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.691 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.691 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_service: /' 2023-11-01T03:20:07.691 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.691 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_service.log 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.692 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.693 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=api_cls_remote_reads 2023-11-01T03:20:07.694 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.695 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.695 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.695 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92200 2023-11-01T03:20:07.695 INFO:tasks.workunit.client.0.smithi005.stdout:test api_cls_remote_reads on pid 92200 2023-11-01T03:20:07.709 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test api_cls_remote_reads on pid 92200' 2023-11-01T03:20:07.709 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92200 2023-11-01T03:20:07.710 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.710 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.710 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.710 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.710 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.711 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.712 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.712 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s list_parallel 2023-11-01T03:20:07.712 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.712 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.712 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.713 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' list_parallel' 2023-11-01T03:20:07.713 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.713 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.713 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_service 2023-11-01T03:20:07.713 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.714 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.715 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.716 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo list_parallel 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.717 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.718 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.719 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.720 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.720 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.720 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.720 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.720 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.721 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.722 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.722 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.722 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.722 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.722 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.723 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.724 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.726 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.727 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.728 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.729 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.730 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.730 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.730 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.730 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.730 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.731 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.732 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.733 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.734 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.735 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.736 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.737 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.738 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.739 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.740 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92127/exe 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.741 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.742 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.743 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_service_pp 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.744 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_service_pp: /' 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.745 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=list_parallel 2023-11-01T03:20:07.747 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.747 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92249 2023-11-01T03:20:07.747 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.747 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.747 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.748 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.749 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.749 INFO:tasks.workunit.client.0.smithi005.stdout:test list_parallel on pid 92249 2023-11-01T03:20:07.752 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test list_parallel on pid 92249' 2023-11-01T03:20:07.752 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92249 2023-11-01T03:20:07.752 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.752 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.752 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s open_pools_parallel 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' open_pools_parallel' 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92167/exe 2023-11-01T03:20:07.753 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.754 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo open_pools_parallel 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.755 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.756 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.756 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.756 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.756 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.756 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.757 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=open_pools_parallel 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.758 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92259 2023-11-01T03:20:07.759 INFO:tasks.workunit.client.0.smithi005.stdout:test open_pools_parallel on pid 92259 2023-11-01T03:20:07.772 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test open_pools_parallel on pid 92259' 2023-11-01T03:20:07.772 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92259 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.773 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.774 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-11-01T03:20:07.774 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.774 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.774 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.774 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_c_read_operations 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.775 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.776 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.777 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.778 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.779 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.780 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.781 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.781 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.781 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.781 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.781 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.782 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:++ printf %25s delete_pools_parallel 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ r=' delete_pools_parallel' 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.785 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.786 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.786 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.786 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.786 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.786 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.787 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:++ echo delete_pools_parallel 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92143/exe 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.788 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.789 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.790 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.791 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.792 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.792 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.792 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.792 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.792 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.793 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.794 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.795 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.796 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.796 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.796 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.796 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.796 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.797 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.798 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.799 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.800 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.801 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_c_write_operations 2023-11-01T03:20:07.801 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-11-01T03:20:07.801 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92200/exe 2023-11-01T03:20:07.801 INFO:tasks.workunit.client.0.smithi005.stderr:++ awk '{print $1}' 2023-11-01T03:20:07.801 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.802 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-11-01T03:20:07.802 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.802 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.802 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.802 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.804 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.805 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_cls_remote_reads 2023-11-01T03:20:07.806 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.806 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.806 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.806 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.806 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:+ ff=delete_pools_parallel 2023-11-01T03:20:07.807 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92307 2023-11-01T03:20:07.808 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'test delete_pools_parallel on pid 92307' 2023-11-01T03:20:07.808 INFO:tasks.workunit.client.0.smithi005.stdout:test delete_pools_parallel on pid 92307 2023-11-01T03:20:07.816 INFO:tasks.workunit.client.0.smithi005.stderr:+ pids[$f]=92307 2023-11-01T03:20:07.817 INFO:tasks.workunit.client.0.smithi005.stderr:+ ret=0 2023-11-01T03:20:07.817 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2023-11-01T03:20:07.817 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:20:07.817 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91739 2023-11-01T03:20:07.817 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91739 2023-11-01T03:20:07.818 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.818 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.818 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.818 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.818 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.819 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.820 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.820 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.820 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.820 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.820 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.821 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.822 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.824 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.825 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.825 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.825 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.825 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.825 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.826 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.827 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.827 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.827 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.827 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.827 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.828 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.829 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.829 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.829 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92249/exe 2023-11-01T03:20:07.829 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.829 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.830 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.831 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.831 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.831 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.831 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ list_parallel: /' 2023-11-01T03:20:07.831 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_list_parallel 2023-11-01T03:20:07.832 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_list_parallel.log 2023-11-01T03:20:07.832 INFO:tasks.workunit.client.0.smithi005.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-11-01T03:20:07.832 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -f /etc/bashrc ']' 2023-11-01T03:20:07.832 INFO:tasks.workunit.client.0.smithi005.stderr:+ . /etc/bashrc 2023-11-01T03:20:07.832 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -z '' ']' 2023-11-01T03:20:07.833 INFO:tasks.workunit.client.0.smithi005.stderr:++ BASHRCSOURCED=Y 2023-11-01T03:20:07.833 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.833 INFO:tasks.workunit.client.0.smithi005.stderr:++ shopt -q login_shell 2023-11-01T03:20:07.833 INFO:tasks.workunit.client.0.smithi005.stderr:+++ umask 2023-11-01T03:20:07.833 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' 0022 -eq 0 ']' 2023-11-01T03:20:07.834 INFO:tasks.workunit.client.0.smithi005.stderr:++ SHELL=/bin/bash 2023-11-01T03:20:07.834 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.834 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-01T03:20:07.834 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.834 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-01T03:20:07.835 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-01T03:20:07.835 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.835 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-01T03:20:07.835 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.835 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.836 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-01T03:20:07.837 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.837 INFO:tasks.workunit.client.0.smithi005.stdout:subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380001e10 con 0x564f58808730 2023-11-01T03:20:07.837 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.257+0000 7f63970de640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f588a4c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f638c009ac0 tx=0x7f63800040e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:20:07.837 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.258+0000 7f63948d9640 10 client.?.objecter ms_handle_connect 0x564f58808730 2023-11-01T03:20:07.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.258+0000 7f63948d9640 10 client.?.objecter resend_mon_ops 2023-11-01T03:20:07.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c070070 con 0x564f58808730 2023-11-01T03:20:07.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:20:07.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:20:07.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: dump: 2023-11-01T03:20:07.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 1 2023-11-01T03:20:07.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:07.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 18 (reef) 2023-11-01T03:20:07.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:20:07.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:20:07.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:20:07.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: _finish_auth 0 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: _check_auth_tickets 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c056ea0 con 0x564f58808730 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:20:07.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c055410 con 0x564f58808730 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63948d9640 10 monclient: dump: 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: epoch 1 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:07.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: min_mon_release 18 (reef) 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: election_strategy: 1 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:20:07.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:20:07.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.318+0000 7f63950da640 4 set_mon_vals no callback set 2023-11-01T03:20:07.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 5 monclient: authenticate success, global_id 4364 2023-11-01T03:20:07.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 monclient: _renew_subs 2023-11-01T03:20:07.855 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'grep=grep --color=auto' 2023-11-01T03:20:07.855 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-01T03:20:07.855 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-01T03:20:07.855 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.855 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorls.sh 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' '!' -t 0 ']' 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:+++ return 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.856 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-01T03:20:07.857 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.857 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-01T03:20:07.857 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export S_COLORS=auto 2023-11-01T03:20:07.857 INFO:tasks.workunit.client.0.smithi005.stderr:+++ S_COLORS=auto 2023-11-01T03:20:07.858 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.858 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-01T03:20:07.858 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.858 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-01T03:20:07.858 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.859 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.860 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.860 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.860 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.860 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.860 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.861 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.861 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.861 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.861 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.861 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.862 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.863 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.863 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.863 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.863 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.863 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92259/exe 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.864 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-01T03:20:07.865 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.865 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-01T03:20:07.865 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-01T03:20:07.865 INFO:tasks.workunit.client.0.smithi005.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-01T03:20:07.865 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.866 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.866 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.866 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.866 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.866 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.867 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-11-01T03:20:07.868 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_open_pools_parallel 2023-11-01T03:20:07.868 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-01T03:20:07.868 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-01T03:20:07.868 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-11-01T03:20:07.868 INFO:tasks.workunit.client.0.smithi005.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-01T03:20:07.869 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.869 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-01T03:20:07.869 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.869 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-01T03:20:07.869 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-01T03:20:07.870 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.870 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-01T03:20:07.870 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.870 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/gawk.sh 2023-11-01T03:20:07.870 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.871 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-01T03:20:07.871 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.871 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/lang.sh 2023-11-01T03:20:07.871 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup 2023-11-01T03:20:07.871 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/locale 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-01T03:20:07.872 INFO:tasks.workunit.client.0.smithi005.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-01T03:20:07.873 INFO:tasks.workunit.client.0.smithi005.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-01T03:20:07.873 INFO:tasks.workunit.client.0.smithi005.stderr:++++ export LANG=en_US.UTF-8 2023-11-01T03:20:07.873 INFO:tasks.workunit.client.0.smithi005.stderr:++++ LANG=en_US.UTF-8 2023-11-01T03:20:07.873 INFO:tasks.workunit.client.0.smithi005.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-01T03:20:07.873 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ LANG=en_US.UTF-8 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ unset LANG_backup config 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n '' ']' 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-01T03:20:07.874 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' dumb = linux ']' 2023-11-01T03:20:07.875 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.875 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-01T03:20:07.875 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.875 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/less.sh 2023-11-01T03:20:07.875 INFO:tasks.workunit.client.0.smithi005.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-01T03:20:07.876 INFO:tasks.workunit.client.0.smithi005.stderr:++ for i in /etc/profile.d/*.sh 2023-11-01T03:20:07.877 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-01T03:20:07.877 INFO:tasks.workunit.client.0.smithi005.stderr:++ '[' '' ']' 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:++ . /etc/profile.d/which2.sh 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:+++++ readlink /proc/92307/exe 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:++++ basename /usr/bin/bash 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_declare='declare -f' 2023-11-01T03:20:07.878 INFO:tasks.workunit.client.0.smithi005.stderr:+++ which_opt=-f 2023-11-01T03:20:07.879 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export which_declare 2023-11-01T03:20:07.879 INFO:tasks.workunit.client.0.smithi005.stderr:+++ export -f which 2023-11-01T03:20:07.879 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset i 2023-11-01T03:20:07.879 INFO:tasks.workunit.client.0.smithi005.stderr:++ unset -f pathmunge 2023-11-01T03:20:07.879 INFO:tasks.workunit.client.0.smithi005.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-01T03:20:07.880 INFO:tasks.workunit.client.0.smithi005.stderr:+ export PATH 2023-11-01T03:20:07.880 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-01T03:20:07.880 INFO:tasks.workunit.client.0.smithi005.stderr:+ unset rc 2023-11-01T03:20:07.880 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_delete_pools_parallel 2023-11-01T03:20:07.880 INFO:tasks.workunit.client.0.smithi005.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-11-01T03:20:07.881 INFO:tasks.workunit.client.0.smithi005.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-11-01T03:20:07.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:07.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f58693380 con 0x564f58808730 2023-11-01T03:20:07.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:20:07.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 monclient: _renew_subs 2023-11-01T03:20:07.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:07.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f5874d9a0 con 0x564f58808730 2023-11-01T03:20:07.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 1 librados: init done 2023-11-01T03:20:07.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.319+0000 7f63995da780 10 librados: wait_for_osdmap waiting 2023-11-01T03:20:07.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.392+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f638c06a450 con 0x564f58808730 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393+0000 7f63948d9640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f638406aa40 0x7f638406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393+0000 7f63968dd640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f638406aa40 0x7f638406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393+0000 7f63968dd640 10 monclient: get_auth_request con 0x7f638406aa40 auth_method 0 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393+0000 7f63968dd640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f638406aa40 0x7f638406cf00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63880030a0 tx=0x7f638800c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.393+0000 7f63948d9640 10 client.4364.objecter ms_handle_connect 0x7f638406aa40 2023-11-01T03:20:07.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f638c09dac0 con 0x564f58808730 2023-11-01T03:20:07.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(21..21 src has 1..21) v4 2023-11-01T03:20:07.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [21,21] > 0 2023-11-01T03:20:07.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding full epoch 21 2023-11-01T03:20:07.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:07.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63995da780 10 librados: wait_for_osdmap done waiting 2023-11-01T03:20:07.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63995da780 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:07.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.397+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f638c055790 con 0x564f58808730 2023-11-01T03:20:07.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f638c099700 con 0x564f58808730 2023-11-01T03:20:09.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63948d9640 10 monclient: handle_get_version_reply finishing 1 version 21 2023-11-01T03:20:09.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63958db640 10 client.4364.objecter _get_latest_version latest 21, have it 2023-11-01T03:20:09.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63995da780 10 client.4364.objecter create_pool name=ceph_test_rados_api_asio 2023-11-01T03:20:09.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63995da780 10 client.4364.objecter pool_op_submit 1 2023-11-01T03:20:09.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63995da780 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:09.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:07.413+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x564f58703260 con 0x564f58808730 2023-11-01T03:20:09.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 7 ==== pool_op_reply(tid 1 (0) Success v23) v1 ==== 43+0+0 (secure 0 0 0) 0x7f638c065020 con 0x564f58808730 2023-11-01T03:20:09.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 pool_op_reply(tid 1 (0) Success v23) v1 2023-11-01T03:20:09.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 client.4364.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v23) v1 2023-11-01T03:20:09.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 client.4364.objecter have request 1 at 0x564f58895880 Op: create 2023-11-01T03:20:09.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 20 client.4364.objecter waiting for client to reach epoch 23 before calling back 2023-11-01T03:20:09.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:20:09.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 monclient: _renew_subs 2023-11-01T03:20:09.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:09.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=22}) v3 -- 0x7f6384070780 con 0x564f58808730 2023-11-01T03:20:09.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.510+0000 7f63948d9640 10 client.4364.objecter done 2023-11-01T03:20:09.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.607+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 8 ==== osd_map(22..23 src has 1..23) v4 ==== 10823+0+0 (secure 0 0 0) 0x7f638c09d3c0 con 0x564f58808730 2023-11-01T03:20:09.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.607+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(22..23 src has 1..23) v4 2023-11-01T03:20:09.613 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.607+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [22,23] > 21 2023-11-01T03:20:09.613 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.607+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 22 2023-11-01T03:20:09.613 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.607+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 23 2023-11-01T03:20:09.613 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:09.613 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 10 librados: set snap read head -> 1 2023-11-01T03:20:09.614 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 10 librados: writefull oid=exist nspace= 2023-11-01T03:20:09.614 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58895dc0 2023-11-01T03:20:09.614 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 23 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:09.614 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:09.614 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:09.821 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:11.131 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.848 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:11.157 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.859 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:11.130 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.864 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:11.135 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.890 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:11.200 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.893 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:11.203 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.901 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:11.211 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.909 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:11.181 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:09.972 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:11.281 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:14.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x564f58896770 0x564f58896b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:20:14.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:14.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 2 osd.7 2023-11-01T03:20:14.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:14.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 2 2023-11-01T03:20:14.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 15 client.4364.objecter _send_op 2 to 9.1 on osd.7 2023-11-01T03:20:14.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:2 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v8 -- 0x564f588981c0 con 0x564f58896770 2023-11-01T03:20:14.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:14.136 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.608+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:14.136 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:09.933+0000 7f63978df640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x564f58896770 0x564f58896b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:20:14.136 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.034+0000 7f63978df640 10 monclient: get_auth_request con 0x564f58896770 auth_method 0 2023-11-01T03:20:14.136 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.077+0000 7f63948d9640 10 client.4364.objecter ms_handle_connect 0x564f58896770 2023-11-01T03:20:14.136 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.077+0000 7f63978df640 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x564f58896770 0x564f58896b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:20:14.137 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:14.137 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:14.137 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:14.137 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:10.132+0000 7f637f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:20:14.137 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:11.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:14.138 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:11.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:14.138 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:11.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:14.138 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:12.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:14.138 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:12.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:14.138 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:12.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:14.139 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:12.320+0000 7f6399342640 10 client.4364.objecter tick 2023-11-01T03:20:14.139 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:13.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:14.139 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:13.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:14.139 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:13.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:14.139 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:14.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:19.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2023-11-01T03:20:19.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [----------] Global test environment set-up. 2023-11-01T03:20:19.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [----------] 4 tests from LibRadosService 2023-11-01T03:20:19.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-11-01T03:20:19.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5831 ms) 2023-11-01T03:20:19.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-11-01T03:20:19.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ OK ] LibRadosService.RegisterLate (64 ms) 2023-11-01T03:20:19.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-11-01T03:20:19.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: cluster: 2023-11-01T03:20:19.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: id: 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:19.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: health: HEALTH_WARN 2023-11-01T03:20:19.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 5 pool(s) do not have an application enabled 2023-11-01T03:20:19.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.107 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: services: 2023-11-01T03:20:19.107 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-01T03:20:19.107 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mgr: y(active, since 117s), standbys: x 2023-11-01T03:20:19.107 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: osd: 8 osds: 8 up (since 73s), 8 in (since 117s) 2023-11-01T03:20:19.107 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-11-01T03:20:19.108 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.108 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: data: 2023-11-01T03:20:19.108 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pools: 25 pools, 745 pgs 2023-11-01T03:20:19.108 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: objects: 2 objects, 449 KiB 2023-11-01T03:20:19.108 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pgs: 92.215% pgs unknown 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 6.443% pgs not active 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 687 unknown 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 45 creating+peering 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 10 active+clean 2023-11-01T03:20:19.109 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 3 creating+activating 2023-11-01T03:20:19.110 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.110 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.110 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: cluster: 2023-11-01T03:20:19.110 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: id: 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:19.110 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: health: HEALTH_WARN 2023-11-01T03:20:19.111 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 9 pool(s) do not have an application enabled 2023-11-01T03:20:19.111 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.111 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: services: 2023-11-01T03:20:19.111 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-01T03:20:19.111 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mgr: y(active, since 119s), standbys: x 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: osd: 8 osds: 8 up (since 75s), 8 in (since 119s) 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: data: 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pools: 28 pools, 817 pgs 2023-11-01T03:20:19.112 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: objects: 2 objects, 449 KiB 2023-11-01T03:20:19.113 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2023-11-01T03:20:19.113 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pgs: 71.114% pgs unknown 2023-11-01T03:20:19.113 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 27.540% pgs not active 2023-11-01T03:20:19.113 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 581 unknown 2023-11-01T03:20:19.113 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 216 creating+peering 2023-11-01T03:20:19.114 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 11 active+clean 2023-11-01T03:20:19.114 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 9 creating+activating 2023-11-01T03:20:19.114 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.114 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.114 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: cluster: 2023-11-01T03:20:19.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: id: 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:20:19.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: health: HEALTH_WARN 2023-11-01T03:20:19.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 7 pool(s) do not have an application enabled 2023-11-01T03:20:19.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: services: 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: mgr: y(active, since 2m), standbys: x 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: osd: 8 osds: 8 up (since 77s), 8 in (since 2m) 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-11-01T03:20:19.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:19.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: data: 2023-11-01T03:20:19.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pools: 29 pools, 849 pgs 2023-11-01T03:20:19.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: objects: 2 objects, 449 KiB 2023-11-01T03:20:20.829 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 Gi api_asio: 2023-11-01T03:20:14.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.829 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:14.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.830 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:15.133+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.830 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:15.133+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.830 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:15.133+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.830 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:16.133+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.830 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:16.133+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.831 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:16.133+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.831 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:17.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.831 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:17.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.831 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:17.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.831 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:17.320+0000 7f6399342640 10 client.4364.objecter tick 2023-11-01T03:20:20.832 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:18.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.832 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:18.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.832 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:18.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.832 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:19.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.832 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:19.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:19.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.132+0000 7f637f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:20:20.833 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 1 ==== osd_map(24..27 src has 1..27) v4 ==== 11622+0+0 (crc 0 0 0) 0x7f63900112c0 con 0x564f58896770 2023-11-01T03:20:20.834 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(24..27 src has 1..27) v4 2023-11-01T03:20:20.834 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [24,27] > 23 2023-11-01T03:20:20.834 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 24 2023-11-01T03:20:20.834 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:20.834 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 24 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:20.835 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:20.835 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 25 2023-11-01T03:20:20.835 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:20.835 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 25 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:20.836 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:22.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 26 2023-11-01T03:20:22.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:22.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 26 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:22.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:22.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 27 2023-11-01T03:20:22.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:22.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 27 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:22.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:22.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:22.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:20.827+0000 7f63948d9640 20 client.4364.objecter 2 9.d3a59201 osd.7 exist [writefull 0~5 in=5b] 2023-11-01T03:20:22.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:21.132+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:22.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:21.132+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:22.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:21.132+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:22.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.133+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:22.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.133+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.133+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 10 client.4364.objecter tick 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 2 client.4364.objecter tid 2 on osd.7 is laggy 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 10 monclient: _renew_subs 2023-11-01T03:20:22.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:20:22.331 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=28}) v3 -- 0x7f6368002f90 con 0x564f58808730 2023-11-01T03:20:22.331 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.321+0000 7f6399342640 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- ping magic: 0 v1 -- 0x7f6368003320 con 0x564f58896770 2023-11-01T03:20:22.331 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== mon.2 v2:172.21.15.5:3301/0 9 ==== osd_map(28..32 src has 1..32) v4 ==== 3138+0+0 (secure 0 0 0) 0x7f638c09b500 con 0x564f58808730 2023-11-01T03:20:22.331 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(28..32 src has 1..32) v4 2023-11-01T03:20:22.331 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [28,32] > 27 2023-11-01T03:20:22.332 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 28 2023-11-01T03:20:22.332 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:22.332 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 28 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:22.332 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.528 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 29 2023-11-01T03:20:25.528 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:25.528 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 29 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:25.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 30 2023-11-01T03:20:25.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:25.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 30 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:25.529 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 31 2023-11-01T03:20:25.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:25.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 31 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:25.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.530 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 32 2023-11-01T03:20:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 10 client.4364.objecter checking op 2 2023-11-01T03:20:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 32 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:25.531 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:22.325+0000 7f63948d9640 20 client.4364.objecter 2 9.d3a59201 osd.7 exist [writefull 0~5 in=5b] 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:23.133+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:23.133+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:23.133+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:24.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:24.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:25.532 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:24.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:25.533 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:25.533 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:25.533 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:25.533 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 2 ==== osd_op_reply(2 exist [writefull 0~5] v27'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.533 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(2 exist [writefull 0~5] v27'1 uv1 ondisk = 0) v8 2023-11-01T03:20:25.534 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.534 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 2 ondisk uv 1 in 9.1 attempt 0 2023-11-01T03:20:25.534 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:25.534 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 2 2023-11-01T03:20:25.535 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 15 client.4364.objecter _finish_op 2 2023-11-01T03:20:25.535 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.535 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 2 2023-11-01T03:20:25.535 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:25.535 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 librados: Objecter returned from writefull r=0 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58895dc0 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 32 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.536 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 3 osd.7 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 3 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 15 client.4364.objecter _send_op 3 to 9.1 on osd.7 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:3 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f587fe180 con 0x564f58896770 2023-11-01T03:20:25.537 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.538 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.538 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f587fe520 2023-11-01T03:20:25.538 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 32 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.538 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 4 osd.7 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 4 2023-11-01T03:20:25.539 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 15 client.4364.objecter _send_op 4 to 9.1 on osd.7 2023-11-01T03:20:25.601 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:4 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564f587fe9c0 con 0x564f58896770 2023-11-01T03:20:25.601 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.601 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.527+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.549+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 3 ==== osd_map(33..33 src has 1..33) v4 ==== 644+0+0 (crc 0 0 0) 0x7f6390001890 con 0x564f58896770 2023-11-01T03:20:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.549+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(33..33 src has 1..33) v4 2023-11-01T03:20:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.549+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [33,33] > 32 2023-11-01T03:20:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.549+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 33 2023-11-01T03:20:25.602 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 10 client.4364.objecter checking op 3 2023-11-01T03:20:25.603 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.603 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.603 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 10 client.4364.objecter checking op 4 2023-11-01T03:20:25.603 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 33 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter 3 9.d3a59201 osd.7 exist [read 0~256] 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.550+0000 7f63948d9640 20 client.4364.objecter 4 9.a7bbaa1 osd.7 noexist [read 0~256] 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.604 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 3 ondisk uv 1 in 9.1 attempt 0 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 3 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 15 client.4364.objecter _finish_op 3 2023-11-01T03:20:25.605 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.606 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 3 2023-11-01T03:20:25.606 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.586+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.606 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 5 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.606 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:25.606 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 4 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 4 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 15 client.4364.objecter _finish_op 4 2023-11-01T03:20:25.607 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.608 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 4 2023-11-01T03:20:25.608 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:25.608 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (73 ms) 2023-11-01T03:20:25.608 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-11-01T03:20:25.608 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f587fe520 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 5 osd.7 2023-11-01T03:20:25.609 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 5 2023-11-01T03:20:25.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 15 client.4364.objecter _send_op 5 to 9.1 on osd.7 2023-11-01T03:20:25.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:5 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f58895dc0 con 0x564f58896770 2023-11-01T03:20:25.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.610 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58803470 2023-11-01T03:20:25.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:25.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.611 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.612 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 6 osd.7 2023-11-01T03:20:25.629 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.629 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 6 2023-11-01T03:20:25.629 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 15 client.4364.objecter _send_op 6 to 9.1 on osd.7 2023-11-01T03:20:25.629 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:6 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f58803910 con 0x564f58896770 2023-11-01T03:20:25.630 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.630 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.600+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:25.630 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 6 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.630 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-01T03:20:25.631 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.631 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 5 ondisk uv 1 in 9.1 attempt 0 2023-11-01T03:20:25.631 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:25.631 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 5 2023-11-01T03:20:25.631 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter _finish_op 5 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 5 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 7 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:25.632 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.633 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 6 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:25.633 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:25.633 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:25.633 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 6 2023-11-01T03:20:25.633 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter _finish_op 6 2023-11-01T03:20:25.634 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.634 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 6 2023-11-01T03:20:25.634 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:25.634 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (28 ms) 2023-11-01T03:20:25.634 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-11-01T03:20:25.660 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58803470 2023-11-01T03:20:25.661 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.661 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.661 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.661 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.662 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 7 osd.7 2023-11-01T03:20:25.662 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.662 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 7 2023-11-01T03:20:25.662 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 15 client.4364.objecter _send_op 7 to 9.1 on osd.7 2023-11-01T03:20:25.662 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:7 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f587fe500 con 0x564f58896770 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804360 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:25.663 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.664 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.664 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 8 osd.7 2023-11-01T03:20:25.664 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.664 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 8 2023-11-01T03:20:25.664 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 15 client.4364.objecter _send_op 8 to 9.1 on osd.7 2023-11-01T03:20:25.665 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:8 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f58804800 con 0x564f58896770 2023-11-01T03:20:25.665 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.665 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.628+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:25.665 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 8 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.665 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-01T03:20:25.666 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.667 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 7 ondisk uv 1 in 9.1 attempt 0 2023-11-01T03:20:25.667 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:25.667 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 7 2023-11-01T03:20:25.667 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 15 client.4364.objecter _finish_op 7 2023-11-01T03:20:25.667 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:25.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 7 2023-11-01T03:20:25.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.660+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:25.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 9 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:25.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:25.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:25.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 8 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:25.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:25.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:25.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 8 2023-11-01T03:20:25.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 15 client.4364.objecter _finish_op 8 2023-11-01T03:20:25.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:25.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 8 2023-11-01T03:20:25.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.665+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:25.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (37 ms) 2023-11-01T03:20:25.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-11-01T03:20:25.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-01T03:20:25.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f58897820 write_seq 1 2023-11-01T03:20:25.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58803470 2023-11-01T03:20:25.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:25.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:25.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:25.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:25.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 9 osd.7 2023-11-01T03:20:25.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:28.158 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 9 2023-11-01T03:20:28.159 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 15 client.4364.objecter _send_op 9 to 9.1 on osd.7 2023-11-01T03:20:28.159 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:9 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f588ba240 con 0x564f58896770 2023-11-01T03:20:28.159 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:28.159 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:28.159 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:25.666+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-01T03:20:28.160 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:26.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:28.160 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:26.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:28.160 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:26.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:28.160 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:27.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:28.160 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:27.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:27.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:27.322+0000 7f6399342640 10 client.4364.objecter tick 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:28.161 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 10 ==== osd_op_reply(9 exist [write 0~5] v33'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:28.162 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(9 exist [write 0~5] v33'2 uv2 ondisk = 0) v8 2023-11-01T03:20:28.162 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:28.162 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 9 ondisk uv 2 in 9.1 attempt 0 2023-11-01T03:20:28.162 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:28.162 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 9 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 15 client.4364.objecter _finish_op 9 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 9 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63978df640 20 librados: complete_aio_write 0x564f58897820 2023-11-01T03:20:28.163 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2492 ms) 2023-11-01T03:20:28.164 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-11-01T03:20:28.164 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-01T03:20:28.164 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f586744e0 write_seq 2 2023-11-01T03:20:28.164 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58803470 2023-11-01T03:20:29.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:29.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:29.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:29.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:29.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 10 osd.7 2023-11-01T03:20:29.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:29.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 10 2023-11-01T03:20:29.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 15 client.4364.objecter _send_op 10 to 9.1 on osd.7 2023-11-01T03:20:29.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:10 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f588ba240 con 0x564f58896770 2023-11-01T03:20:29.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:29.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:29.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:28.157+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-01T03:20:29.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:29.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:29.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:29.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 11 ==== osd_map(34..36 src has 1..37) v4 ==== 2301+0+0 (crc 0 0 0) 0x7f6390011de0 con 0x564f58896770 2023-11-01T03:20:29.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(34..36 src has 1..37) v4 2023-11-01T03:20:29.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [34,36] > 33 2023-11-01T03:20:29.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 34 2023-11-01T03:20:29.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 10 client.4364.objecter checking op 10 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 35 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 10 client.4364.objecter checking op 10 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 35 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:29.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:29.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 36 2023-11-01T03:20:29.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 10 client.4364.objecter checking op 10 2023-11-01T03:20:29.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 36 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.201+0000 7f63948d9640 20 client.4364.objecter 10 9.d3a59201 osd.7 exist [write 0~5 in=5b] 2023-11-01T03:20:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 12 ==== osd_op_reply(10 exist [write 0~5] v36'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(10 exist [write 0~5] v36'3 uv3 ondisk = 0) v8 2023-11-01T03:20:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 10 ondisk uv 3 in 9.1 attempt 0 2023-11-01T03:20:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 10 2023-11-01T03:20:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 15 client.4364.objecter _finish_op 10 2023-11-01T03:20:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 10 2023-11-01T03:20:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63978df640 20 librados: complete_aio_write 0x564f586744e0 2023-11-01T03:20:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1585 ms) 2023-11-01T03:20:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-11-01T03:20:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-01T03:20:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f58803470 write_seq 3 2023-11-01T03:20:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f588dc5e0 2023-11-01T03:20:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 36 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.742+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 11 osd.7 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 11 2023-11-01T03:20:29.749 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 15 client.4364.objecter _send_op 11 to 9.1 on osd.7 2023-11-01T03:20:29.749 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:11 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) v8 -- 0x564f588dca80 con 0x564f58896770 2023-11-01T03:20:29.749 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.802 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:30.802 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.743+0000 7f63995da780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-01T03:20:30.803 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 13 ==== osd_map(37..37 src has 1..38) v4 ==== 1040+0+0 (crc 0 0 0) 0x7f6390011480 con 0x564f58896770 2023-11-01T03:20:30.803 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(37..37 src has 1..38) v4 2023-11-01T03:20:30.803 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [37,37] > 36 2023-11-01T03:20:30.803 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 37 2023-11-01T03:20:30.803 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 10 client.4364.objecter checking op 11 2023-11-01T03:20:30.804 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 37 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:30.804 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:30.804 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:30.804 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:29.859+0000 7f63948d9640 20 client.4364.objecter 11 9.d3a59201 osd.7 exist [write 0~5 in=5b] 2023-11-01T03:20:30.804 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:30.805 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:30.805 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:30.805 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.134+0000 7f637f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:20:30.805 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 14 ==== osd_op_reply(11 exist [write 0~5] v37'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:30.805 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(11 exist [write 0~5] v37'4 uv4 ondisk = 0) v8 2023-11-01T03:20:30.806 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:30.806 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 11 ondisk uv 4 in 9.1 attempt 0 2023-11-01T03:20:30.806 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:30.806 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 11 2023-11-01T03:20:30.806 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 15 client.4364.objecter _finish_op 11 2023-11-01T03:20:30.807 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.807 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 11 2023-11-01T03:20:30.807 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:30.807 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63978df640 20 librados: complete_aio_write 0x564f58803470 2023-11-01T03:20:30.807 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1059 ms) 2023-11-01T03:20:30.808 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-11-01T03:20:30.808 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58803cf0 2023-11-01T03:20:30.808 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 37 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.808 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:30.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:30.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 12 osd.7 2023-11-01T03:20:30.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 12 2023-11-01T03:20:30.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 15 client.4364.objecter _send_op 12 to 9.1 on osd.7 2023-11-01T03:20:30.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:12 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x564f58804190 con 0x564f58896770 2023-11-01T03:20:30.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:30.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804600 2023-11-01T03:20:30.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 37 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:30.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:30.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 13 osd.7 2023-11-01T03:20:30.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 13 2023-11-01T03:20:30.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 15 client.4364.objecter _send_op 13 to 9.1 on osd.7 2023-11-01T03:20:30.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:13 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x564f588bbf60 con 0x564f58896770 2023-11-01T03:20:30.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:30.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.801+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:30.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 16 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:30.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 15 ==== osd_map(38..38 src has 1..39) v4 ==== 699+0+0 (crc 0 0 0) 0x7f6390001d70 con 0x564f58896770 2023-11-01T03:20:30.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-01T03:20:30.852 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(38..38 src has 1..39) v4 2023-11-01T03:20:30.852 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:30.852 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 12 ondisk uv 4 in 9.1 attempt 0 2023-11-01T03:20:30.852 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:30.852 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 12 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter _finish_op 12 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 12 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [38,38] > 37 2023-11-01T03:20:30.853 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 38 2023-11-01T03:20:30.854 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 17 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:30.854 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:30.854 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:30.854 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 10 client.4364.objecter checking op 13 2023-11-01T03:20:30.854 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 38 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.855 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:30.855 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:30.855 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63948d9640 20 client.4364.objecter 13 9.a7bbaa1 osd.7 noexist [read 0~0] 2023-11-01T03:20:30.855 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 13 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:30.855 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 13 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter _finish_op 13 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 13 2023-11-01T03:20:30.856 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:30.857 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (45 ms) 2023-11-01T03:20:30.857 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-11-01T03:20:30.857 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804710 2023-11-01T03:20:30.857 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 38 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.857 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:30.941 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:30.941 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.941 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 14 osd.7 2023-11-01T03:20:30.941 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.942 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 14 2023-11-01T03:20:30.942 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 15 client.4364.objecter _send_op 14 to 9.1 on osd.7 2023-11-01T03:20:30.942 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:14 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x564f58803cf0 con 0x564f58896770 2023-11-01T03:20:30.942 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.943 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:30.943 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f588bbf60 2023-11-01T03:20:30.943 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 38 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.943 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:30.943 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 15 osd.7 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 15 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 15 client.4364.objecter _send_op 15 to 9.1 on osd.7 2023-11-01T03:20:30.944 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:15 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x564f588bc400 con 0x564f58896770 2023-11-01T03:20:30.945 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:30.945 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.846+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:30.945 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 18 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:30.945 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-01T03:20:30.945 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:30.946 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 14 ondisk uv 4 in 9.1 attempt 0 2023-11-01T03:20:30.946 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:30.992 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 14 2023-11-01T03:20:30.993 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 15 client.4364.objecter _finish_op 14 2023-11-01T03:20:30.993 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:30.993 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 14 2023-11-01T03:20:30.993 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.940+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:30.993 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 19 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:30.994 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:30.994 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:30.994 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 15 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:30.994 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:30.994 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 15 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 15 client.4364.objecter _finish_op 15 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 15 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:30.995 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (145 ms) 2023-11-01T03:20:30.996 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-11-01T03:20:30.996 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804710 2023-11-01T03:20:30.996 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 38 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:30.996 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:30.996 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:30.997 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.997 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 16 osd.7 2023-11-01T03:20:30.997 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:30.997 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 16 2023-11-01T03:20:30.997 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 15 client.4364.objecter _send_op 16 to 9.1 on osd.7 2023-11-01T03:20:30.998 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:16 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x564f58803cf0 con 0x564f58896770 2023-11-01T03:20:30.998 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:31.641 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:31.642 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f588fc5f0 2023-11-01T03:20:31.642 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 38 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:31.642 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:31.642 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:31.642 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:31.643 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 10 client.4364.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 17 osd.7 2023-11-01T03:20:31.643 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:31.643 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 17 2023-11-01T03:20:31.643 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 15 client.4364.objecter _send_op 17 to 9.1 on osd.7 2023-11-01T03:20:31.643 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:17 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x564f588fca90 con 0x564f58896770 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:30.991+0000 7f63995da780 5 client.4364.objecter 2 in flight 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:31.644 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 20 ==== osd_map(39..39 src has 1..39) v4 ==== 644+0+0 (crc 0 0 0) 0x7f6390011930 con 0x564f58896770 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 21 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_map(39..39 src has 1..39) v4 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 3 client.4364.objecter handle_osd_map got epochs [39,39] > 38 2023-11-01T03:20:31.645 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 3 client.4364.objecter handle_osd_map decoding incremental epoch 39 2023-11-01T03:20:31.646 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 10 client.4364.objecter checking op 16 2023-11-01T03:20:31.646 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.639+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 39 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:31.646 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:31.646 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 10 client.4364.objecter checking op 17 2023-11-01T03:20:31.646 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter _calc_target epoch 39 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter dump_active .. 0 homeless 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter 16 9.d3a59201 osd.7 exist [read 0~0] 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63948d9640 20 client.4364.objecter 17 9.a7bbaa1 osd.7 noexist [read 0~0] 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (649 ms) 2023-11-01T03:20:31.647 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-11-01T03:20:31.648 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 16 ondisk uv 4 in 9.1 attempt 0 2023-11-01T03:20:31.648 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 5 2023-11-01T03:20:31.648 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 16 2023-11-01T03:20:31.648 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter _finish_op 16 2023-11-01T03:20:31.648 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 5 2023-11-01T03:20:31.649 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 16 2023-11-01T03:20:31.649 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 5 client.4364.objecter 1 in flight 2023-11-01T03:20:31.649 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 22 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:31.649 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-01T03:20:31.649 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 17 ondisk uv 0 in 9.1 attempt 0 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 10 client.4364.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 17 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter _finish_op 17 2023-11-01T03:20:31.650 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 17 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f588036f0 write_seq 4 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804710 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 39 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:31.651 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:31.652 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:31.652 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.201 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 18 osd.7 2023-11-01T03:20:32.201 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.201 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 18 2023-11-01T03:20:32.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 15 client.4364.objecter _send_op 18 to 9.1 on osd.7 2023-11-01T03:20:32.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:18 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39) v8 -- 0x564f58803cf0 con 0x564f58896770 2023-11-01T03:20:32.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:32.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:31.640+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:32.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.134+0000 7f637f7fe640 10 monclient: tick 2023-11-01T03:20:32.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.134+0000 7f637f7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:20:32.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.134+0000 7f637f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:20:32.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 23 ==== osd_op_reply(18 exist [writefull 0~5] v39'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:32.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(18 exist [writefull 0~5] v39'5 uv5 ondisk = 0) v8 2023-11-01T03:20:32.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:32.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 18 ondisk uv 5 in 9.1 attempt 0 2023-11-01T03:20:32.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:32.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 18 2023-11-01T03:20:32.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 15 client.4364.objecter _finish_op 18 2023-11-01T03:20:32.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:32.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 18 2023-11-01T03:20:32.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:32.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63978df640 20 librados: complete_aio_write 0x564f588036f0 2023-11-01T03:20:32.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (560 ms) 2023-11-01T03:20:32.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f58804bb0 write_seq 5 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804710 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 39 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:32.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 19 osd.7 2023-11-01T03:20:32.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 19 2023-11-01T03:20:32.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 15 client.4364.objecter _send_op 19 to 9.1 on osd.7 2023-11-01T03:20:32.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:19 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39) v8 -- 0x564f58803cf0 con 0x564f58896770 2023-11-01T03:20:32.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:32.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.200+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.323+0000 7f6399342640 10 client.4364.objecter tick 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 24 ==== osd_op_reply(19 exist [writefull 0~5] v39'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(19 exist [writefull 0~5] v39'6 uv6 ondisk = 0) v8 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 19 ondisk uv 6 in 9.1 attempt 0 2023-11-01T03:20:32.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 19 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 15 client.4364.objecter _finish_op 19 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 19 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:32.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63978df640 20 librados: complete_aio_write 0x564f58804bb0 2023-11-01T03:20:32.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (644 ms) 2023-11-01T03:20:32.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-11-01T03:20:32.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 librados: queue_aio_write 0x564f586f22c0 completion 0x564f58804230 write_seq 6 2023-11-01T03:20:32.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 10 client.4364.objecter _op_submit op 0x564f58804710 2023-11-01T03:20:32.849 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 client.4364.objecter _calc_target epoch 39 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2023-11-01T03:20:32.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 client.4364.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2023-11-01T03:20:32.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 10 client.4364.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [7,4] primary 7 2023-11-01T03:20:32.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 client.4364.objecter _get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 10 client.4364.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 20 osd.7 2023-11-01T03:20:32.850 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 client.4364.objecter get_session s=0x564f58693f80 osd=7 3 2023-11-01T03:20:32.851 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 15 client.4364.objecter _session_op_assign 7 20 2023-11-01T03:20:33.099 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 15 client.4364.objecter _send_op 20 to 9.1 on osd.7 2023-11-01T03:20:33.099 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- osd_op(unknown.0.0:20 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39) v8 -- 0x564f58803cf0 con 0x564f58896770 2023-11-01T03:20:33.099 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:33.100 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:32.844+0000 7f63995da780 5 client.4364.objecter 1 in flight 2023-11-01T03:20:33.100 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 <== osd.7 v2:172.21.15.153:6808/1714004960 25 ==== osd_op_reply(20 exist [writefull 0~5] v39'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f6390001610 con 0x564f58896770 2023-11-01T03:20:33.100 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 10 client.4364.objecter ms_dispatch 0x564f586caee0 osd_op_reply(20 exist [writefull 0~5] v39'7 uv7 ondisk = 0) v8 2023-11-01T03:20:33.100 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 10 client.4364.objecter in handle_osd_op_reply 2023-11-01T03:20:33.100 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 7 client.4364.objecter handle_osd_op_reply 20 ondisk uv 7 in 9.1 attempt 0 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 10 client.4364.objecter op 0 rval 0 len 0 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 15 client.4364.objecter handle_osd_op_reply completed tid 20 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 15 client.4364.objecter _finish_op 20 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 4 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 15 client.4364.objecter _session_op_remove 7 20 2023-11-01T03:20:33.101 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 5 client.4364.objecter 0 in flight 2023-11-01T03:20:33.102 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 20 librados: complete_aio_write 0x564f58804230 2023-11-01T03:20:33.102 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (254 ms) 2023-11-01T03:20:33.102 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 10 librados: watch_flush enter 2023-11-01T03:20:33.102 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 10 librados: watch_flush exit 2023-11-01T03:20:33.102 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 10 client.4364.objecter close_session for osd.7 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x564f58896770 msgr2=0x564f58896b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x564f58896770 0x564f58896b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 20 client.4364.objecter put_session s=0x564f58693f80 osd=7 1 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 20 client.4364.objecter shutdown clearing up homeless session... 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 10 client.4364.objecter successfully canceled tick 2023-11-01T03:20:33.103 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f638406aa40 msgr2=0x7f638406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:33.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f638406aa40 0x7f638406cf00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f63880030a0 tx=0x7f638800c040 comp rx=0 tx=0).stop 2023-11-01T03:20:33.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 10 monclient: shutdown 2023-11-01T03:20:33.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:20:33.104 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 msgr2=0x564f588a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 --2- 172.21.15.5:0/1412679441 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x564f58808730 0x564f588a4c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f638c009ac0 tx=0x7f63800040e0 comp rx=0 tx=0).stop 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63978df640 1 -- 172.21.15.5:0/1412679441 reap_dead start 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 shutdown_connections 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 >> 172.21.15.5:0/1412679441 conn(0x564f58782a80 msgr2=0x564f5877e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 shutdown_connections 2023-11-01T03:20:33.105 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 -- 172.21.15.5:0/1412679441 wait complete. 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.098+0000 7f63995da780 1 librados: shutdown 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [----------] 12 tests from AsioRados (7571 ms total) 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [----------] Global test environment tear-down 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (25993 ms total) 2023-11-01T03:20:33.106 INFO:tasks.workunit.client.0.smithi005.stdout: api_asio: [ PASSED ] 12 tests. 2023-11-01T03:20:35.183 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:36.492 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.189 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:36.499 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.246 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:36.518 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.253 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:36.524 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.254 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:36.564 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.261 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:36.571 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.453 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:36.724 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.526 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:36.836 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:35.570 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:36.880 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:38.054 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-11-01T03:20:38.054 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [----------] Global test environment set-up. 2023-11-01T03:20:38.054 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-11-01T03:20:38.054 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-11-01T03:20:38.055 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5276 ms) 2023-11-01T03:20:38.055 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-11-01T03:20:38.055 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (129 ms) 2023-11-01T03:20:38.055 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-11-01T03:20:38.055 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20068 ms) 2023-11-01T03:20:38.056 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-11-01T03:20:38.056 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: attempt 0 of 20 2023-11-01T03:20:38.056 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: failed to deregister: 2023-11-01T03:20:38.056 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: { 2023-11-01T03:20:38.057 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "epoch": 12, 2023-11-01T03:20:38.057 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "modified": "2023-11-01T03:20:33.178635+0000", 2023-11-01T03:20:38.057 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "services": { 2023-11-01T03:20:38.057 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "laundry": { 2023-11-01T03:20:38.057 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "daemons": { 2023-11-01T03:20:38.058 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "summary": "", 2023-11-01T03:20:38.058 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "close-test-pid92239": { 2023-11-01T03:20:38.058 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "start_epoch": 12, 2023-11-01T03:20:38.058 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "start_stamp": "2023-11-01T03:20:32.876389+0000", 2023-11-01T03:20:38.058 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "gid": 4536, 2023-11-01T03:20:38.059 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "addr": "172.21.15.5:0/4116080572", 2023-11-01T03:20:38.059 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "metadata": { 2023-11-01T03:20:38.059 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "arch": "x86_64", 2023-11-01T03:20:38.059 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_release": "reef", 2023-11-01T03:20:38.059 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-6776-g420cd129 (420cd129397301b1521ceb74e1bdbd9b855d2189) reef (dev)", 2023-11-01T03:20:38.060 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_version_short": "18.0.0-6776-g420cd129", 2023-11-01T03:20:38.060 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-11-01T03:20:38.060 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "distro": "centos", 2023-11-01T03:20:38.060 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-11-01T03:20:38.060 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "distro_version": "9", 2023-11-01T03:20:38.061 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "foo": "bar", 2023-11-01T03:20:38.061 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "hostname": "smithi005", 2023-11-01T03:20:38.061 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Oct 19 18:39:36 UTC 2023", 2023-11-01T03:20:38.061 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "kernel_version": "5.14.0-378.el9.x86_64", 2023-11-01T03:20:38.061 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "mem_swap_kb": "0", 2023-11-01T03:20:38.062 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "mem_total_kb": "32494896", 2023-11-01T03:20:38.062 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "os": "Linux", 2023-11-01T03:20:38.062 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "this": "that" 2023-11-01T03:20:38.062 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: }, 2023-11-01T03:20:38.062 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "task_status": {} 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: }, 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "pid92197": { 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "start_epoch": 11, 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "start_stamp": "2023-11-01T03:20:19.229888+0000", 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "gid": 4541, 2023-11-01T03:20:38.063 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "addr": "172.21.15.5:0/1930630393", 2023-11-01T03:20:38.064 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "metadata": { 2023-11-01T03:20:38.064 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "arch": "x86_64", 2023-11-01T03:20:38.064 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_release": "reef", 2023-11-01T03:20:38.064 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-6776-g420cd129 (420cd129397301b1521ceb74e1bdbd9b855d2189) reef (dev)", 2023-11-01T03:20:38.064 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "ceph_version_short": "18.0.0-6776-g420cd129", 2023-11-01T03:20:38.065 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-11-01T03:20:39.225 INFO:tasks.workunit.client.0.smithi005.stdout: B avail 2023-11-01T03:20:39.225 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: pgs: 17.903% pgs unknown 2023-11-01T03:20:39.225 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 79.388% pgs not active 2023-11-01T03:20:39.226 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 515 creating+peering 2023-11-01T03:20:39.226 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 159 creating+activating 2023-11-01T03:20:39.226 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 152 unknown 2023-11-01T03:20:39.226 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 23 active+clean 2023-11-01T03:20:39.226 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:39.227 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:39.227 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ OK ] LibRadosService.StatusFormat (5956 ms) 2023-11-01T03:20:39.227 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ RUN ] LibRadosService.Status 2023-11-01T03:20:39.227 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ OK ] LibRadosService.Status (20082 ms) 2023-11-01T03:20:39.227 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [----------] 4 tests from LibRadosService (31933 ms total) 2023-11-01T03:20:39.228 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: 2023-11-01T03:20:39.228 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [----------] Global test environment tear-down 2023-11-01T03:20:39.228 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [==========] 4 tests from 1 test suite ran. (31933 ms total) 2023-11-01T03:20:39.228 INFO:tasks.workunit.client.0.smithi005.stdout: api_service: [ PASSED ] 4 tests. 2023-11-01T03:20:43.389 INFO:tasks.workunit.client.0.smithi005.stdout:api_service_pp: "distro": "centos", 2023-11-01T03:20:43.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-11-01T03:20:43.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "distro_version": "9", 2023-11-01T03:20:43.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "foo": "bar", 2023-11-01T03:20:43.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "hostname": "smithi005", 2023-11-01T03:20:43.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Oct 19 18:39:36 UTC 2023", 2023-11-01T03:20:43.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "kernel_version": "5.14.0-378.el9.x86_64", 2023-11-01T03:20:43.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "mem_swap_kb": "0", 2023-11-01T03:20:43.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "mem_total_kb": "32494896", 2023-11-01T03:20:43.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "os": "Linux", 2023-11-01T03:20:43.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "this": "that" 2023-11-01T03:20:43.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: }, 2023-11-01T03:20:43.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: "task_status": {} 2023-11-01T03:20:43.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: } 2023-11-01T03:20:43.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: } 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: } 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: } 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: } 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: attempt 1 of 20 2023-11-01T03:20:43.392 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10616 ms) 2023-11-01T03:20:43.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36089 ms total) 2023-11-01T03:20:43.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: 2023-11-01T03:20:43.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [----------] Global test environment tear-down 2023-11-01T03:20:43.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36089 ms total) 2023-11-01T03:20:43.393 INFO:tasks.workunit.client.0.smithi005.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-11-01T03:20:54.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: Running main() from gmock_main.cc 2023-11-01T03:20:54.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-11-01T03:20:54.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [----------] Global test environment set-up. 2023-11-01T03:20:54.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-11-01T03:20:54.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-11-01T03:20:54.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolList (5294 ms) 2023-11-01T03:20:54.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-11-01T03:20:54.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3987 ms) 2023-11-01T03:20:54.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-11-01T03:20:54.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4464 ms) 2023-11-01T03:20:54.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-11-01T03:20:54.672 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3767 ms) 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3821 ms) 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5942 ms) 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-11-01T03:20:54.673 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5556 ms) 2023-11-01T03:20:54.674 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-11-01T03:20:54.674 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5637 ms) 2023-11-01T03:20:54.674 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-11-01T03:20:54.674 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (9051 ms) 2023-11-01T03:20:54.674 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [----------] 9 tests from LibRadosPools (47519 ms total) 2023-11-01T03:20:54.675 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: 2023-11-01T03:20:54.675 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [----------] Global test environment tear-down 2023-11-01T03:20:54.675 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (47519 ms total) 2023-11-01T03:20:54.675 INFO:tasks.workunit.client.0.smithi005.stdout: api_pool: [ PASSED ] 9 tests. 2023-11-01T03:20:55.175 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:56.484 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.185 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:56.495 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.206 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:56.516 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.250 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:56.521 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.253 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:56.525 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.264 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:56.574 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.355 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:02:56.626 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.375 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:02:56.685 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.416 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:02:56.725 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:20:55.921 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-11-01T03:20:55.921 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-11-01T03:20:55.922 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-11-01T03:20:55.922 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-11-01T03:20:55.922 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (48588 ms) 2023-11-01T03:20:55.922 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (48588 ms total) 2023-11-01T03:20:55.923 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: 2023-11-01T03:20:55.923 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-11-01T03:20:55.923 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (48588 ms total) 2023-11-01T03:20:55.923 INFO:tasks.workunit.client.0.smithi005.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2023-11-01T03:21:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-11-01T03:21:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] Global test environment set-up. 2023-11-01T03:21:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-11-01T03:21:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-11-01T03:21:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-11-01T03:21:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:20:07.320+0000 7f1140158780 -1 failed for service _ceph-mon._tcp 2023-11-01T03:21:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:20:07.320+0000 7f1140158780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-11-01T03:21:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (246 ms) 2023-11-01T03:21:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-11-01T03:21:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2012 ms) 2023-11-01T03:21:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2258 ms total) 2023-11-01T03:21:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:21:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-11-01T03:21:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-11-01T03:21:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a935470 2023-11-01T03:21:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a94f160 2023-11-01T03:21:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369d2bca0 2023-11-01T03:21:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a936e30 2023-11-01T03:21:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a0a2770 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a0a31d0 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a0a3cf0 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e85110 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e85c30 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e866f0 2023-11-01T03:21:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e859d0 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e87620 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e86410 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e88470 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e873d0 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a0a43d0 2023-11-01T03:21:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b36a0a4d80 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 0x55b369e88270 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: started 18 aios 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a935470 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a94f160 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369d2bca0 2023-11-01T03:21:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a936e30 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a0a2770 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a0a31d0 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a0a3cf0 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e85110 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e85c30 2023-11-01T03:21:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e866f0 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e859d0 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e87620 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e86410 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e88470 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e873d0 2023-11-01T03:21:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a0a43d0 2023-11-01T03:21:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b36a0a4d80 2023-11-01T03:21:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: waiting 0x55b369e88270 2023-11-01T03:21:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: done. 2023-11-01T03:21:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (25705 ms) 2023-11-01T03:21:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (25705 ms total) 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-11-01T03:21:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.Exec (9583 ms) 2023-11-01T03:21:09.020 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2023-11-01T03:21:09.020 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (21782 ms) 2023-11-01T03:21:15.746 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:03:17.055 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.826 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:03:17.135 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.857 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:03:17.166 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.870 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:03:17.141 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.885 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:03:17.157 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.918 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:03:17.227 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.926 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:03:17.236 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:15.970 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:03:17.241 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:16.057 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:03:17.364 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:37.515 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] L api_cmd_pp: Running main() from gmock_main.cc 2023-11-01T03:21:37.515 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2023-11-01T03:21:37.516 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [----------] Global test environment set-up. 2023-11-01T03:21:37.516 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2023-11-01T03:21:37.516 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2023-11-01T03:21:37.516 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (650 ms) 2023-11-01T03:21:37.516 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2023-11-01T03:21:37.517 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (802 ms) 2023-11-01T03:21:37.517 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2023-11-01T03:21:37.517 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (88803 ms) 2023-11-01T03:21:37.517 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (90255 ms total) 2023-11-01T03:21:37.517 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: 2023-11-01T03:21:37.518 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [----------] Global test environment tear-down 2023-11-01T03:21:37.518 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (90256 ms total) 2023-11-01T03:21:37.518 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2023-11-01T03:21:38.237 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: Running main() from gmock_main.cc 2023-11-01T03:21:38.237 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2023-11-01T03:21:38.237 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [----------] Global test environment set-up. 2023-11-01T03:21:38.237 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2023-11-01T03:21:38.238 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2023-11-01T03:21:38.238 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2023-11-01T03:21:38.238 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2023-11-01T03:21:38.238 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (32116 ms) 2023-11-01T03:21:38.238 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2023-11-01T03:21:38.239 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (15666 ms) 2023-11-01T03:21:38.239 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2023-11-01T03:21:38.239 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (7249 ms) 2023-11-01T03:21:38.239 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (3859 ms) 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (5274 ms) 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (5666 ms) 2023-11-01T03:21:38.240 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2023-11-01T03:21:38.241 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (2481 ms) 2023-11-01T03:21:38.241 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2023-11-01T03:21:38.241 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (808 ms) 2023-11-01T03:21:38.241 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2023-11-01T03:21:38.241 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (2058 ms) 2023-11-01T03:21:38.242 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2023-11-01T03:21:38.242 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (192 ms) 2023-11-01T03:21:38.242 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2023-11-01T03:21:38.242 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (133 ms) 2023-11-01T03:21:38.242 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2023-11-01T03:21:38.243 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (99 ms) 2023-11-01T03:21:38.243 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2023-11-01T03:21:38.243 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (533 ms) 2023-11-01T03:21:38.243 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2023-11-01T03:21:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (370 ms) 2023-11-01T03:21:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2023-11-01T03:21:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (238 ms) 2023-11-01T03:21:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2023-11-01T03:21:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (205 ms) 2023-11-01T03:21:38.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (76948 ms total) 2023-11-01T03:21:38.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: 2023-11-01T03:21:38.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [----------] Global test environment tear-down 2023-11-01T03:21:38.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (90933 ms total) 2023-11-01T03:21:38.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2023-11-01T03:21:40.069 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2023-11-01T03:21:40.069 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] Global test environment set-up. 2023-11-01T03:21:40.070 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 7 tests from LibRadosList 2023-11-01T03:21:40.070 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2023-11-01T03:21:40.070 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.ListObjects (72820 ms) 2023-11-01T03:21:40.070 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2023-11-01T03:21:40.071 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (3301 ms) 2023-11-01T03:21:40.071 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2023-11-01T03:21:40.071 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo1,foo2,foo3 2023-11-01T03:21:40.071 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo1 2023-11-01T03:21:40.071 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo2 2023-11-01T03:21:40.072 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo3 2023-11-01T03:21:40.072 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo1,foo4,foo5 2023-11-01T03:21:40.072 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo4 2023-11-01T03:21:40.072 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo5 2023-11-01T03:21:40.072 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo1 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo6,foo7 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo7 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo6 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo4 2023-11-01T03:21:40.073 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo5 2023-11-01T03:21:40.074 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns2:foo7 2023-11-01T03:21:40.074 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns2:foo6 2023-11-01T03:21:40.074 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo1 2023-11-01T03:21:40.074 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo1 2023-11-01T03:21:40.074 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo2 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo3 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (2306 ms) 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 1 0 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 10 0 2023-11-01T03:21:40.075 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 13 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 7 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 14 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 0 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 15 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 11 0 2023-11-01T03:21:40.076 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 5 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 8 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 6 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 3 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 4 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 12 0 2023-11-01T03:21:40.077 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 9 0 2023-11-01T03:21:40.078 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 2 0 2023-11-01T03:21:40.078 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-11-01T03:21:40.078 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (2207 ms) 2023-11-01T03:21:40.078 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2023-11-01T03:21:40.078 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: x cursor=MIN 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=1 cursor=6:02547ec2:::1:head 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=10 cursor=6:52ea6a34:::10:head 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=13 cursor=6:566253c9:::13:head 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=7 cursor=6:5c6b0b28:::7:head 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=14 cursor=6:62a1935d:::14:head 2023-11-01T03:21:40.079 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=0 cursor=6:6cac518f:::0:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=15 cursor=6:863748b0:::15:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=11 cursor=6:89d3ae78:::11:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=5 cursor=6:b29083e3:::5:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=8 cursor=6:bd63b0f1:::8:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=6 cursor=6:c4fdafeb:::6:head 2023-11-01T03:21:40.080 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=3 cursor=6:cfc208b3:::3:head 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=4 cursor=6:d83876eb:::4:head 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=12 cursor=6:de5d7c5f:::12:head 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=9 cursor=6:e960b815:::9:head 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > oid=2 cursor=6:f905c69b:::2:head 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: FIRST> seek to MIN oid=1 2023-11-01T03:21:40.081 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=1 cursor=6:02547ec2:::1:head 2023-11-01T03:21:40.082 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:02547ec2:::1:head 2023-11-01T03:21:40.082 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:02547ec2:::1:head -> 1 2023-11-01T03:21:40.082 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=10 cursor=6:52ea6a34:::10:head 2023-11-01T03:21:40.082 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:52ea6a34:::10:head 2023-11-01T03:21:40.082 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2023-11-01T03:21:40.083 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=13 cursor=6:566253c9:::13:head 2023-11-01T03:21:40.083 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:566253c9:::13:head 2023-11-01T03:21:40.083 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:566253c9:::13:head -> 13 2023-11-01T03:21:40.083 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=7 cursor=6:5c6b0b28:::7:head 2023-11-01T03:21:40.084 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2023-11-01T03:21:40.084 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2023-11-01T03:21:45.378 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=14 cursor=6:62a1935d:::14:head 2023-11-01T03:21:45.378 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:62a1935d:::14:head 2023-11-01T03:21:45.379 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:62a1935d:::14:head -> 14 2023-11-01T03:21:45.379 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=0 cursor=6:6cac518f:::0:head 2023-11-01T03:21:45.379 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:6cac518f:::0:head 2023-11-01T03:21:45.379 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:6cac518f:::0:head -> 0 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=15 cursor=6:863748b0:::15:head 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:863748b0:::15:head 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:863748b0:::15:head -> 15 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=11 cursor=6:89d3ae78:::11:head 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:89d3ae78:::11:head 2023-11-01T03:21:45.380 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2023-11-01T03:21:45.381 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=5 cursor=6:b29083e3:::5:head 2023-11-01T03:21:45.381 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:b29083e3:::5:head 2023-11-01T03:21:45.381 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:b29083e3:::5:head -> 5 2023-11-01T03:21:45.381 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=8 cursor=6:bd63b0f1:::8:head 2023-11-01T03:21:45.381 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2023-11-01T03:21:45.382 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2023-11-01T03:21:45.382 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=6 cursor=6:c4fdafeb:::6:head 2023-11-01T03:21:45.382 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2023-11-01T03:21:45.382 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2023-11-01T03:21:45.382 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=3 cursor=6:cfc208b3:::3:head 2023-11-01T03:21:45.383 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:cfc208b3:::3:head 2023-11-01T03:21:45.383 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2023-11-01T03:21:45.383 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=4 cursor=6:d83876eb:::4:head 2023-11-01T03:21:45.383 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:d83876eb:::4:head 2023-11-01T03:21:45.383 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:d83876eb:::4:head -> 4 2023-11-01T03:21:45.384 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=12 cursor=6:de5d7c5f:::12:head 2023-11-01T03:21:45.384 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2023-11-01T03:21:45.384 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2023-11-01T03:21:45.384 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=9 cursor=6:e960b815:::9:head 2023-11-01T03:21:45.384 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:e960b815:::9:head 2023-11-01T03:21:45.385 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:e960b815:::9:head -> 9 2023-11-01T03:21:45.385 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : oid=2 cursor=6:f905c69b:::2:head 2023-11-01T03:21:45.385 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:f905c69b:::2:head 2023-11-01T03:21:45.385 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:f905c69b:::2:head -> 2 2023-11-01T03:21:45.385 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:02547ec2:::1:head 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:02547ec2:::1:head expected=6:02547ec2:::1:head 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:02547ec2:::1:head -> 1 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=1 expected=1 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:f905c69b:::2:head 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:f905c69b:::2:head expected=6:f905c69b:::2:head 2023-11-01T03:21:45.386 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:f905c69b:::2:head -> 2 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=2 expected=2 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:e960b815:::9:head 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:e960b815:::9:head expected=6:e960b815:::9:head 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:e960b815:::9:head -> 9 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=9 expected=9 2023-11-01T03:21:45.387 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2023-11-01T03:21:45.388 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:de5d7c5f:::12:head expected=6:de5d7c5f:::12:head 2023-11-01T03:21:45.388 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2023-11-01T03:21:45.388 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=12 expected=12 2023-11-01T03:21:45.388 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:d83876eb:::4:head 2023-11-01T03:21:45.388 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:d83876eb:::4:head expected=6:d83876eb:::4:head 2023-11-01T03:21:45.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:d83876eb:::4:head -> 4 2023-11-01T03:21:45.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=4 expected=4 2023-11-01T03:21:45.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:cfc208b3:::3:head 2023-11-01T03:21:45.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:cfc208b3:::3:head expected=6:cfc208b3:::3:head 2023-11-01T03:21:45.389 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2023-11-01T03:21:45.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=3 expected=3 2023-11-01T03:21:45.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2023-11-01T03:21:45.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:c4fdafeb:::6:head expected=6:c4fdafeb:::6:head 2023-11-01T03:21:45.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2023-11-01T03:21:45.390 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=6 expected=6 2023-11-01T03:21:45.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2023-11-01T03:21:45.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:bd63b0f1:::8:head expected=6:bd63b0f1:::8:head 2023-11-01T03:21:45.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2023-11-01T03:21:45.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=8 expected=8 2023-11-01T03:21:45.391 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:b29083e3:::5:head 2023-11-01T03:21:46.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: api_cmd: Running main() from gmock_main.cc 2023-11-01T03:21:46.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [----------] Global test environment set-up. 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1093 ms) 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2023-11-01T03:21:46.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (381 ms) 2023-11-01T03:21:46.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2023-11-01T03:21:46.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (88164 ms) 2023-11-01T03:21:46.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2023-11-01T03:21:46.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:25.363738+0000 mon.c [INF] from='client.? 172.21.15.5:0/548749997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi005-92074-4", "tierpool": "test-rados-api-smithi005-92074-6", "force_nonempty": "--force-nonempty" }]: dispatch 2023-11-01T03:21:46.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:32.417881+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi005-92074-4", "tierpool": "test-rados-api-smithi005-92074-6", "force_nonempty": "--force-nonempty" }]: dispatch 2023-11-01T03:21:46.970 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:32.804423+0000 mon.a [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-01T03:21:46.970 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:35.065403+0000 mon.b [INF] from='client.? 172.21.15.5:0/2901253188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi005-91780-10"}]: dispatch 2023-11-01T03:21:46.970 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:35.727685+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi005-91895-4"}]': finished 2023-11-01T03:21:46.970 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:35.746456+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi005-92074-4", "tierpool": "test-rados-api-smithi005-92074-6", "force_nonempty": "--force-nonempty" }]': finished 2023-11-01T03:21:46.970 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:36.502854+0000 mon.a [INF] from='client.? 172.21.15.5:0/1154755526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi005-91640-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-01T03:21:46.971 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:36.651486+0000 mon.c [INF] from='client.? 172.21.15.5:0/3659588850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi005-91707-10"}]: dispatch 2023-11-01T03:21:46.971 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:37.227572+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi005-91780-10"}]: dispatch 2023-11-01T03:21:46.971 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:38.115398+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi005-91707-10"}]: dispatch 2023-11-01T03:21:46.971 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:37.059737+0000 mon.b [INF] from='client.? 172.21.15.5:0/3008600911' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi005-91895-4", "tierpool": "test-rados-api-smithi005-91895-4-cache"}]: dispatch 2023-11-01T03:21:46.971 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:37.947451+0000 mon.c [INF] from='client.? 172.21.15.5:0/548749997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi005-92074-4", "overlaypool": "test-rados-api-smithi005-92074-6"}]: dispatch 2023-11-01T03:21:54.880 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:38.262188+0000 mon.c [INF] from='client.? 172.21.15.5:0/1311736934' entity='client.admin' cm api_stat_pp: Running main() from gmock_main.cc 2023-11-01T03:21:54.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2023-11-01T03:21:54.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] Global test environment set-up. 2023-11-01T03:21:54.882 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2023-11-01T03:21:54.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: seed 92019 2023-11-01T03:21:54.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2023-11-01T03:21:54.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (22568 ms) 2023-11-01T03:21:54.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2023-11-01T03:21:54.883 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (2256 ms) 2023-11-01T03:21:54.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2023-11-01T03:21:54.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (412 ms) 2023-11-01T03:21:54.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2023-11-01T03:21:54.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (4697 ms) 2023-11-01T03:21:54.884 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (9727 ms) 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (39660 ms total) 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2023-11-01T03:21:54.885 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (19182 ms) 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (121 ms) 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (8195 ms) 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2023-11-01T03:21:54.886 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (754 ms) 2023-11-01T03:21:54.887 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (28252 ms total) 2023-11-01T03:21:54.887 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: 2023-11-01T03:21:54.887 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [----------] Global test environment tear-down 2023-11-01T03:21:54.887 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (107705 ms total) 2023-11-01T03:21:54.887 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat_pp: [ PASSED ] 9 tests. 2023-11-01T03:21:57.965 INFO:tasks.workunit.client.0.smithi005.stdout:d=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi005-92019-7"}]: dispatch 2023-11-01T03:21:57.966 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:39.519265+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi005-91895-4", "tierpool": "test-rados-api-smithi005-91895-4-cache"}]: dispatch 2023-11-01T03:21:57.966 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:39.752041+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi005-92074-4", "overlaypool": "test-rados-api-smithi005-92074-6"}]: dispatch 2023-11-01T03:21:57.966 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:39.763620+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi005-92019-7"}]: dispatch 2023-11-01T03:21:57.966 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:39.772590+0000 mon.a [INF] from='client.? 172.21.15.5:0/1154755526' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi005-91640-8","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-01T03:21:57.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:39.843145+0000 mon.b [INF] from='client.? 172.21.15.5:0/1424496866' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-11-01T03:21:57.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:40.066457+0000 mon.b [INF] from='client.? 172.21.15.5:0/523875423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:21:57.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:40.686452+0000 mon.a [INF] from='client.? 172.21.15.5:0/1467493314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi005-92023-7"}]: dispatch 2023-11-01T03:21:57.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:40.776879+0000 mon.a [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2023-11-01T03:21:57.967 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:41.307477+0000 client.admin [INF] onexx 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:41.365854+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:41.568138+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:41.877973+0000 mon.a [INF] from='client.? 172.21.15.5:0/1467493314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi005-92023-7"}]: dispatch 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:44.778725+0000 mon.b [INF] from='client.? 172.21.15.5:0/2901253188' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi005-91780-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:44.785614+0000 mon.b [INF] from='client.? 172.21.15.5:0/523875423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:21:57.968 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:45.500390+0000 mon.c [INF] from='client.? 172.21.15.5:0/1311736934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi005-92019-7"}]: dispatch 2023-11-01T03:21:57.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:45.706791+0000 mon.c [INF] from='client.? 172.21.15.5:0/3659588850' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi005-91707-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.969 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:45.717895+0000 mon.c [INF] from='client.? 172.21.15.5:0/1198548091' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi005-91667-22"}]: dispatch 2023-11-01T03:21:57.976 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:45.842475+0000 mon.c [INF] from='client.? 172.21.15.5:0/979489787' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi005-91615-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-01T03:21:57.976 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:45.948220+0000 mon.c [INF] from='client.? 172.21.15.5:0/548749997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi005-92074-6", "mode": "writeback"}]: dispatch 2023-11-01T03:21:57.976 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:46.965176+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi005-91780-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:46.972371+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.310873+0000 mon.b [INF] from='client.? 172.21.15.5:0/1424496866' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.442091+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi005-92019-7"}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.450132+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi005-91707-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.455924+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi005-91667-22"}]: dispatch 2023-11-01T03:21:57.977 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.486994+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi005-91615-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:47.495657+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi005-92074-6", "mode": "writeback"}]: dispatch 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:48.229750+0000 mon.c [INF] from='client.? 172.21.15.5:0/2852002868' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi005-92046-12"}]: dispatch 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:48.605307+0000 mon.a [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:49.451831+0000 client.admin [INF] twoxx 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:49.481694+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2023-11-01T03:21:57.978 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:50.074512+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi005-92046-12"}]: dispatch 2023-11-01T03:21:57.979 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:49.491233+0000 mon.b [INF] from='client.? 172.21.15.5:0/523875423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi005-91655-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.979 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:50.074662+0000 mon.c [INF] from='client.? 172.21.15.5:0/1198548091' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi005-91667-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.979 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:50.084266+0000 mon.b [INF] from='client.? 172.21.15.5:0/2312987865' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi005-92286-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-01T03:21:57.979 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.631559+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi005-91655-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.979 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.645170+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi005-92286-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-01T03:21:57.980 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.963162+0000 mon.a [INF] from='client.? 172.21.15.5:0/1467493314' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi005-92023-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-01T03:21:57.980 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.965484+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi005-91780-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-01T03:21:57.980 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.968116+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi005-92019-7"}]': finished 2023-11-01T03:21:57.980 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.970062+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi005-91707-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-01T03:21:57.980 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.976024+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi005-91615-7","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-01T03:21:57.981 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:51.979915+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi005-92074-6", "mode": "writeback"}]': finished 2023-11-01T03:21:57.981 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:52.387675+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi005-91667-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:21:57.981 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:52.770792+0000 mon.a [INF] from='client.? 172.21.15.5:0/1467493314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi005-92023-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi005-92023-7"}]: dispatch 2023-11-01T03:21:57.981 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:53.035173+0000 mon.a [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-01T03:21:57.981 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:53.722185+0000 mon.c [INF] from='client.? 172.21.15.5:0/3659588850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi005-91707-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi005-91707-10"}]: dispatch 2023-11-01T03:21:57.982 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:53.903516+0000 mon.c [INF] from='client.? 172.21.15.5:0/2852002868' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi005-92046-12"}]: dispatch 2023-11-01T03:21:57.982 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:54.018959+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2023-11-01T03:21:58.555 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:03:59.864 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:58.633 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:03:59.943 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:58.834 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:04:00.144 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:59.448 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:00.719 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:59.471 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:00.742 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:59.738 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:01.009 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:59.881 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:01.190 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:21:59.904 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:01.213 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:00.197 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:01.506 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:01.743 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:54.940436+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi005-91707-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Lib list_parallel: process_1_[92386]: starting. 2023-11-01T03:22:01.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: creating pool ceph_test_rados_list_parallel.smithi005-92329 2023-11-01T03:22:01.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: created object 0... 2023-11-01T03:22:01.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: created object 25... 2023-11-01T03:22:01.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: created object 49... 2023-11-01T03:22:01.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: finishing. 2023-11-01T03:22:01.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_1_[92386]: shutting down. 2023-11-01T03:22:01.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: starting. 2023-11-01T03:22:01.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: listing objects. 2023-11-01T03:22:01.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: listed object 0... 2023-11-01T03:22:01.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: listed object 25... 2023-11-01T03:22:01.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: saw 50 objects 2023-11-01T03:22:01.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_2_[92388]: shutting down. 2023-11-01T03:22:01.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: starting. 2023-11-01T03:22:01.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: creating pool ceph_test_rados_list_parallel.smithi005-92329 2023-11-01T03:22:01.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: created object 0... 2023-11-01T03:22:01.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: created object 25... 2023-11-01T03:22:01.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: created object 49... 2023-11-01T03:22:01.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: finishing. 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_3_[107945]: shutting down. 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: starting. 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: listing objects. 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: listed object 0... 2023-11-01T03:22:01.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: listed object 25... 2023-11-01T03:22:01.749 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: saw 44 objects 2023-11-01T03:22:01.749 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_4_[107946]: shutting down. 2023-11-01T03:22:01.749 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.749 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: starting. 2023-11-01T03:22:01.749 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: removed 25 objects... 2023-11-01T03:22:01.750 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: removed half of the objects 2023-11-01T03:22:01.750 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: removed 50 objects... 2023-11-01T03:22:01.750 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: removed 50 objects 2023-11-01T03:22:01.750 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_5_[107947]: shutting down. 2023-11-01T03:22:01.750 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: starting. 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: creating pool ceph_test_rados_list_parallel.smithi005-92329 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: created object 0... 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: created object 25... 2023-11-01T03:22:01.751 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: created object 49... 2023-11-01T03:22:01.752 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: finishing. 2023-11-01T03:22:01.752 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_6_[120146]: shutting down. 2023-11-01T03:22:01.752 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.752 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.752 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: starting. 2023-11-01T03:22:01.753 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: listing objects. 2023-11-01T03:22:01.753 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: listed object 0... 2023-11-01T03:22:01.753 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: listed object 25... 2023-11-01T03:22:01.753 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: listed object 50... 2023-11-01T03:22:01.753 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: saw 55 objects 2023-11-01T03:22:01.754 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_7_[120147]: shutting down. 2023-11-01T03:22:01.754 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.754 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.754 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: starting. 2023-11-01T03:22:01.754 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: added 25 objects... 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: added half of the objects 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: added 50 objects... 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: added 50 objects 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_8_[120148]: shutting down. 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:01.755 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:02.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2023-11-01T03:22:02.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2023-11-01T03:22:02.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2023-11-01T03:22:02.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2023-11-01T03:22:02.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2023-11-01T03:22:02.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify 2023-11-01T03:22:02.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (28094 ms) 2023-11-01T03:22:02.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-11-01T03:22:02.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (3212 ms) 2023-11-01T03:22:02.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (31306 ms total) 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (29236 ms) 2023-11-01T03:22:02.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2023-11-01T03:22:02.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify 2023-11-01T03:22:02.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (39340 ms) 2023-11-01T03:22:02.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2023-11-01T03:22:02.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (340 ms) 2023-11-01T03:22:02.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2023-11-01T03:22:02.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (613 ms) 2023-11-01T03:22:02.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2023-11-01T03:22:02.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626242939392 notify_id 390842023939 notifier_gid 4610 2023-11-01T03:22:02.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (220 ms) 2023-11-01T03:22:02.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626242939392 notify_id 390842023940 notifier_gid 4610 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (234 ms) 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626242939392 notify_id 395136991232 notifier_gid 4610 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (1661 ms) 2023-11-01T03:22:02.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626244042672 notify_id 395136991233 notifier_gid 4610 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (492 ms) 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626244023632 notify_id 395136991234 notifier_gid 4610 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (266 ms) 2023-11-01T03:22:02.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2023-11-01T03:22:02.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626244023632 notify_id 395136991234 notifier_gid 4610 2023-11-01T03:22:02.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (180 ms) 2023-11-01T03:22:02.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2023-11-01T03:22:02.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: trying... 2023-11-01T03:22:02.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626244023632 notify_id 395136991235 notifier_gid 4610 2023-11-01T03:22:02.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: timed out 2023-11-01T03:22:06.867 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushRadosLockEC_smithi005-91707-10"}]: dispatch 2023-11-01T03:22:06.867 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:54.947109+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi005-92046-12"}]: dispatch 2023-11-01T03:22:06.868 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:53.405901+0000 mon.b [INF] from='client.? 172.21.15.5:0/2901253188' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi005-91780-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi005-91780-10"}]: dispatch 2023-11-01T03:22:06.868 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:55.305215+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi005-91780-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi005-91780-10"}]: dispatch 2023-11-01T03:22:06.868 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:55.338327+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi005-91655-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-01T03:22:06.869 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:55.355190+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi005-92286-5","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-01T03:22:06.869 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:55.357475+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi005-91667-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-01T03:22:06.869 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:56.764214+0000 mon.c [INF] from='client.? 172.21.15.5:0/2852002868' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi005-92046-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:22:06.870 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:56.796387+0000 mon.c [INF] from='client.? 172.21.15.5:0/1198548091' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi005-91667-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi005-91667-22"}]: dispatch 2023-11-01T03:22:06.870 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:56.951435+0000 mon.b [INF] from='client.? 172.21.15.5:0/523875423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi005-91655-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:22:06.870 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:57.568448+0000 mon.b [INF] from='client.? 172.21.15.5:0/1424496866' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-11-01T03:22:06.870 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.315269+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi005-92046-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-01T03:22:06.871 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.333633+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi005-91667-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi005-91667-22"}]: dispatch 2023-11-01T03:22:06.871 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.403618+0000 client.admin [INF] threexx 2023-11-01T03:22:06.871 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.425414+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi005-91655-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi005-91655-16"}]: dispatch 2023-11-01T03:22:11.437 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.450227+0000 mon.a [INF] open_pools_parallel: process_1_[92412]: starting. 2023-11-01T03:22:11.437 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: creating pool ceph_test_rados_open_pools_parallel.smithi005-92399 2023-11-01T03:22:11.438 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: created object 0... 2023-11-01T03:22:11.438 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: created object 25... 2023-11-01T03:22:11.438 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: created object 49... 2023-11-01T03:22:11.438 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: finishing. 2023-11-01T03:22:11.439 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_1_[92412]: shutting down. 2023-11-01T03:22:11.439 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_2_[92416]: starting. 2023-11-01T03:22:11.439 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_2_[92416]: rados_pool_create. 2023-11-01T03:22:11.439 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_2_[92416]: rados_ioctx_create. 2023-11-01T03:22:11.440 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_2_[92416]: shutting down. 2023-11-01T03:22:11.440 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: ******************************* 2023-11-01T03:22:11.440 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: starting. 2023-11-01T03:22:11.440 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: creating pool ceph_test_rados_open_pools_parallel.smithi005-92399 2023-11-01T03:22:11.440 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: created object 0... 2023-11-01T03:22:11.441 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: created object 25... 2023-11-01T03:22:11.441 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: created object 49... 2023-11-01T03:22:11.441 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: finishing. 2023-11-01T03:22:11.441 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_3_[115386]: shutting down. 2023-11-01T03:22:11.441 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: ******************************* 2023-11-01T03:22:11.442 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_4_[115387]: starting. 2023-11-01T03:22:11.442 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_4_[115387]: rados_pool_create. 2023-11-01T03:22:11.442 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_4_[115387]: rados_ioctx_create. 2023-11-01T03:22:11.442 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: process_4_[115387]: shutting down. 2023-11-01T03:22:11.442 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: ******************************* 2023-11-01T03:22:11.443 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: ******************************* 2023-11-01T03:22:11.443 INFO:tasks.workunit.client.0.smithi005.stdout: open_pools_parallel: ******* SUCCESS ********** 2023-11-01T03:22:14.268 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.269 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: starting. 2023-11-01T03:22:14.269 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: creating pool ceph_test_rados_list_parallel.smithi005-92329 2023-11-01T03:22:14.269 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: created object 0... 2023-11-01T03:22:14.269 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: created object 25... 2023-11-01T03:22:14.270 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: created object 49... 2023-11-01T03:22:14.270 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: finishing. 2023-11-01T03:22:14.270 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_9_[125651]: shutting down. 2023-11-01T03:22:14.270 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.270 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.271 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.271 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: starting. 2023-11-01T03:22:14.271 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: listing objects. 2023-11-01T03:22:14.271 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: listed object 0... 2023-11-01T03:22:14.271 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: listed object 25... 2023-11-01T03:22:14.272 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: listed object 50... 2023-11-01T03:22:14.272 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: listed object 75... 2023-11-01T03:22:14.272 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: saw 97 objects 2023-11-01T03:22:14.272 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_10_[125652]: shutting down. 2023-11-01T03:22:14.272 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.273 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.273 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.273 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: starting. 2023-11-01T03:22:14.273 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: removed 25 objects... 2023-11-01T03:22:14.273 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: removed half of the objects 2023-11-01T03:22:14.274 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: removed 50 objects... 2023-11-01T03:22:14.274 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: removed 50 objects 2023-11-01T03:22:14.274 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_13_[125656]: shutting down. 2023-11-01T03:22:14.274 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.274 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: starting. 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: added 25 objects... 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: added half of the objects 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: added 50 objects... 2023-11-01T03:22:14.275 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: added 50 objects 2023-11-01T03:22:14.276 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_12_[125655]: shutting down. 2023-11-01T03:22:14.276 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.276 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.276 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.276 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: starting. 2023-11-01T03:22:14.277 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: added 25 objects... 2023-11-01T03:22:14.277 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: added half of the objects 2023-11-01T03:22:14.277 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: added 50 objects... 2023-11-01T03:22:14.277 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: added 50 objects 2023-11-01T03:22:14.277 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_11_[125654]: shutting down. 2023-11-01T03:22:14.278 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.278 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.278 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.278 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.278 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: starting. 2023-11-01T03:22:14.279 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: creating pool ceph_test_rados_list_parallel.smithi005-92329 2023-11-01T03:22:14.279 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: created object 0... 2023-11-01T03:22:14.279 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: created object 25... 2023-11-01T03:22:14.279 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: created object 49... 2023-11-01T03:22:14.279 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: finishing. 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_14_[136072]: shutting down. 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:14.280 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: starting. 2023-11-01T03:22:14.281 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listing objects. 2023-11-01T03:22:16.123 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: delete_pools_parallel: process_1_[92434]: starting. 2023-11-01T03:22:16.124 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: creating pool ceph_test_rados_delete_pools_parallel.smithi005-92408 2023-11-01T03:22:16.124 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: created object 0... 2023-11-01T03:22:16.124 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: created object 25... 2023-11-01T03:22:16.124 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: created object 49... 2023-11-01T03:22:16.125 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: finishing. 2023-11-01T03:22:16.125 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_1_[92434]: shutting down. 2023-11-01T03:22:16.125 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_2_[92435]: starting. 2023-11-01T03:22:16.125 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_2_[92435]: deleting pool ceph_test_rados_delete_pools_parallel.smithi005-92408 2023-11-01T03:22:16.125 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_2_[92435]: shutting down. 2023-11-01T03:22:16.126 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******************************* 2023-11-01T03:22:16.126 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: starting. 2023-11-01T03:22:16.126 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: creating pool ceph_test_rados_delete_pools_parallel.smithi005-92408 2023-11-01T03:22:16.126 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: created object 0... 2023-11-01T03:22:16.127 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: created object 25... 2023-11-01T03:22:16.127 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: created object 49... 2023-11-01T03:22:16.127 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: finishing. 2023-11-01T03:22:16.127 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_3_[115388]: shutting down. 2023-11-01T03:22:16.127 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******************************* 2023-11-01T03:22:16.128 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: starting. 2023-11-01T03:22:16.128 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: listing objects. 2023-11-01T03:22:16.128 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: listed object 0... 2023-11-01T03:22:16.128 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: listed object 25... 2023-11-01T03:22:16.129 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: saw 50 objects 2023-11-01T03:22:16.129 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_5_[115390]: shutting down. 2023-11-01T03:22:16.129 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******************************* 2023-11-01T03:22:16.129 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_4_[115389]: starting. 2023-11-01T03:22:16.129 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_4_[115389]: deleting pool ceph_test_rados_delete_pools_parallel.smithi005-92408 2023-11-01T03:22:16.130 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: process_4_[115389]: shutting down. 2023-11-01T03:22:16.130 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******************************* 2023-11-01T03:22:16.130 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******************************* 2023-11-01T03:22:16.130 INFO:tasks.workunit.client.0.smithi005.stdout: delete_pools_parallel: ******* SUCCESS ********** 2023-11-01T03:22:16.269 INFO:tasks.workunit.client.0.smithi005.stdout: from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-11-01T03:22:16.270 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:58.464512+0000 mon.a [INF] from='client.? 172.21.15.5:0/1467493314' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi005-92023-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi005-92023-7"}]': finished 2023-11-01T03:22:16.270 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: got: 2023-11-01T03:21:59.623307+0000 mon.a [WRN] Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-01T03:22:16.270 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (39393 ms) 2023-11-01T03:22:16.270 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (129031 ms total) 2023-11-01T03:22:16.270 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: 2023-11-01T03:22:16.271 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [----------] Global test environment tear-down 2023-11-01T03:22:16.271 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (129032 ms total) 2023-11-01T03:22:16.271 INFO:tasks.workunit.client.0.smithi005.stdout: api_cmd: [ PASSED ] 4 tests. 2023-11-01T03:22:18.290 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: Running main() from gmock_main.cc 2023-11-01T03:22:18.290 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2023-11-01T03:22:18.290 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] Global test environment set-up. 2023-11-01T03:22:18.291 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2023-11-01T03:22:18.291 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: seed 91667 2023-11-01T03:22:18.291 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2023-11-01T03:22:18.291 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2023-11-01T03:22:18.291 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2023-11-01T03:22:18.292 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (19856 ms) 2023-11-01T03:22:18.292 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2023-11-01T03:22:18.292 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (23393 ms) 2023-11-01T03:22:18.292 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2023-11-01T03:22:18.292 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5769 ms) 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (2576 ms) 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (424 ms) 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2023-11-01T03:22:18.293 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (1818 ms) 2023-11-01T03:22:18.294 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2023-11-01T03:22:18.294 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1361 ms) 2023-11-01T03:22:18.294 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2023-11-01T03:22:18.294 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (8351 ms) 2023-11-01T03:22:18.294 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2023-11-01T03:22:18.295 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (7597 ms) 2023-11-01T03:22:18.295 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2023-11-01T03:22:18.295 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (1335 ms) 2023-11-01T03:22:18.295 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2023-11-01T03:22:18.295 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (203 ms) 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (332 ms) 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (131 ms) 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2023-11-01T03:22:18.296 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (2052 ms) 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (600 ms) 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (273 ms) 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2023-11-01T03:22:18.297 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (183 ms) 2023-11-01T03:22:18.298 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2023-11-01T03:22:18.298 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (88 ms) 2023-11-01T03:22:18.298 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2023-11-01T03:22:18.298 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (230 ms) 2023-11-01T03:22:18.298 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (76572 ms total) 2023-11-01T03:22:18.299 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: 2023-11-01T03:22:18.299 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2023-11-01T03:22:18.299 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2023-11-01T03:22:18.299 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (5751 ms) 2023-11-01T03:22:18.299 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (1247 ms) 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (213 ms) 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (114 ms) 2023-11-01T03:22:18.300 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2023-11-01T03:22:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundT listed object 0... 2023-11-01T03:22:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listed object 25... 2023-11-01T03:22:29.744 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listed object 50... 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listed object 75... 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listed object 100... 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: listed object 125... 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: saw 150 objects 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_15_[136073]: shutting down. 2023-11-01T03:22:29.745 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: starting. 2023-11-01T03:22:29.746 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: added 25 objects... 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: added half of the objects 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: added 50 objects... 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: added 50 objects 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: process_16_[136074]: shutting down. 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.747 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******************************* 2023-11-01T03:22:29.748 INFO:tasks.workunit.client.0.smithi005.stdout: list_parallel: ******* SUCCESS ********** 2023-11-01T03:22:31.936 INFO:tasks.workunit.client.0.smithi005.stdout:ibRadosMisc.CmpExt 2023-11-01T03:22:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2992 ms) 2023-11-01T03:22:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-11-01T03:22:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4824 ms) 2023-11-01T03:22:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-11-01T03:22:31.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (73583 ms) 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] 8 tests from LibRadosMisc (112764 ms total) 2023-11-01T03:22:31.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: 2023-11-01T03:22:31.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [----------] Global test environment tear-down 2023-11-01T03:22:31.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (144844 ms total) 2023-11-01T03:22:31.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc: [ PASSED ] 12 tests. 2023-11-01T03:22:31.950 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: Running main() from gmock_main.cc 2023-11-01T03:22:31.950 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2023-11-01T03:22:31.951 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] Global test environment set-up. 2023-11-01T03:22:31.951 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] 5 tests from LibRadosStat 2023-11-01T03:22:31.951 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2023-11-01T03:22:31.951 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStat.Stat (26583 ms) 2023-11-01T03:22:31.951 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (24338 ms) 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStat.StatNS (16159 ms) 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (2042 ms) 2023-11-01T03:22:31.952 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (4682 ms) 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] 5 tests from LibRadosStat (73804 ms total) 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2023-11-01T03:22:31.953 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (8053 ms) 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (751 ms) 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1541 ms) 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2023-11-01T03:22:31.954 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2123 ms) 2023-11-01T03:22:31.955 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (12468 ms total) 2023-11-01T03:22:31.955 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: 2023-11-01T03:22:31.955 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [----------] Global test environment tear-down 2023-11-01T03:22:31.955 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (144759 ms total) 2023-11-01T03:22:31.955 INFO:tasks.workunit.client.0.smithi005.stdout: api_stat: [ PASSED ] 9 tests. 2023-11-01T03:22:32.142 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:04:33.452 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.200 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:33.471 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.201 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:33.473 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.209 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:33.518 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.210 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:33.520 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.223 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:04:33.533 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.273 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:04:33.545 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.289 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:04:33.598 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:32.374 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:04:33.683 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:22:33.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: Running main() from gmock_main.cc 2023-11-01T03:22:33.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2023-11-01T03:22:33.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] Global test environment set-up. 2023-11-01T03:22:33.245 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] 14 tests from LibRadosIo 2023-11-01T03:22:33.246 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2023-11-01T03:22:33.246 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (21633 ms) 2023-11-01T03:22:33.246 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2023-11-01T03:22:33.246 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2023-11-01T03:22:33.246 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2023-11-01T03:22:33.247 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: no timeout :/ 2023-11-01T03:22:33.247 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: no timeout :/ 2023-11-01T03:22:33.247 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: no timeout :/ 2023-11-01T03:22:33.247 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: no timeout :/ 2023-11-01T03:22:33.247 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: no timeout :/ 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (12777 ms) 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (4555 ms) 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.Checksum (5693 ms) 2023-11-01T03:22:33.248 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2023-11-01T03:22:33.249 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (3947 ms) 2023-11-01T03:22:33.249 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2023-11-01T03:22:33.249 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (11342 ms) 2023-11-01T03:22:33.249 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2023-11-01T03:22:33.249 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (2117 ms) 2023-11-01T03:22:33.250 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2023-11-01T03:22:33.250 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (3354 ms) 2023-11-01T03:22:33.250 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2023-11-01T03:22:33.250 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.TruncTest (8493 ms) 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (342 ms) 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (111 ms) 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2023-11-01T03:22:33.251 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.RmXattr (1661 ms) 2023-11-01T03:22:33.252 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2023-11-01T03:22:33.252 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIo.XattrIter (806 ms) 2023-11-01T03:22:33.252 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] 14 tests from LibRadosIo (76831 ms total) 2023-11-01T03:22:33.252 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: 2023-11-01T03:22:33.252 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2023-11-01T03:22:33.253 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2023-11-01T03:22:33.253 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (6001 ms) 2023-11-01T03:22:33.253 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2023-11-01T03:22:33.253 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (370 ms) 2023-11-01T03:22:33.254 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-11-01T03:22:33.254 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (165 ms) 2023-11-01T03:22:33.254 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2023-11-01T03:22:33.254 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (570 ms) 2023-11-01T03:22:33.254 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (318 ms) 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (406 ms) 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (1795 ms) 2023-11-01T03:22:33.255 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (220 ms) 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (837 ms) 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (175 ms) 2023-11-01T03:22:33.256 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] 10 tests from LibRadosIoEC (10857 ms total) 2023-11-01T03:22:33.257 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: Running main() from gmock_main.cc 2023-11-01T03:22:33.257 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2023-11-01T03:22:33.257 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] Global test environment set-up. 2023-11-01T03:22:33.258 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2023-11-01T03:22:33.258 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: seed 91780 2023-11-01T03:22:33.258 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2023-11-01T03:22:33.258 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (21190 ms) 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (7451 ms) 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (7346 ms) 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2023-11-01T03:22:33.259 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (8744 ms) 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (7871 ms) 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (7920 ms) 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2023-11-01T03:22:33.260 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (11346 ms) 2023-11-01T03:22:33.261 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2023-11-01T03:22:33.261 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (162 ms) 2023-11-01T03:22:33.261 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (72030 ms total) 2023-11-01T03:22:33.261 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: 2023-11-01T03:22:33.261 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2023-11-01T03:22:33.262 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2023-11-01T03:22:33.262 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (6351 ms) 2023-11-01T03:22:33.262 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2023-11-01T03:22:33.262 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (2924 ms) 2023-11-01T03:22:33.262 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2023-11-01T03:22:33.263 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1155 ms) 2023-11-01T03:22:33.263 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2023-11-01T03:22:33.263 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (2478 ms) 2023-11-01T03:22:33.263 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2023-11-01T03:22:33.263 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (401 ms) 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (383 ms) 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (407 ms) 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2023-11-01T03:22:33.264 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (334 ms) 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (14433 ms total) 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [----------] Global test environment tear-down 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (146173 ms total) 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock_pp: [ PASSED ] 16 tests. 2023-11-01T03:22:33.265 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: 2023-11-01T03:22:33.266 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [----------] Global test environment tear-down 2023-11-01T03:22:33.266 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [==========] 24 tests from 2 test suites ran. (146228 ms total) 2023-11-01T03:22:33.266 INFO:tasks.workunit.client.0.smithi005.stdout: api_io: [ PASSED ] 24 tests. 2023-11-01T03:22:33.332 INFO:tasks.workunit.client.0.smithi005.stdout:ing 2023-11-01T03:22:33.332 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushed 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3178 ms) 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: trying... 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626245351008 notify_id 399431958531 notifier_gid 4610 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: timed out 2023-11-01T03:22:33.333 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushing 2023-11-01T03:22:33.334 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushed 2023-11-01T03:22:33.334 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (4506 ms) 2023-11-01T03:22:33.334 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2023-11-01T03:22:33.334 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: List watches 2023-11-01T03:22:33.334 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify2 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626245344048 notify_id 403726925828 notifier_gid 4610 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify2 done 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: watch_check 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: unwatch2 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushing 2023-11-01T03:22:33.335 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: done 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3935 ms) 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: List watches 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify2 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: handle_notify cookie 94626245344048 notify_id 408021893124 notifier_gid 4610 2023-11-01T03:22:33.336 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: notify2 done 2023-11-01T03:22:33.337 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: watch_check 2023-11-01T03:22:33.337 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: unwatch2 2023-11-01T03:22:33.337 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: flushing 2023-11-01T03:22:33.337 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: done 2023-11-01T03:22:33.337 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3947 ms) 2023-11-01T03:22:33.338 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (88150 ms total) 2023-11-01T03:22:33.338 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: 2023-11-01T03:22:33.338 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2023-11-01T03:22:33.338 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (146108 ms total) 2023-11-01T03:22:33.338 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2023-11-01T03:22:33.339 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-11-01T03:22:33.339 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-11-01T03:22:33.339 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-11-01T03:22:33.339 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-11-01T03:22:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-11-01T03:22:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify_test_cb 2023-11-01T03:22:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (21414 ms) 2023-11-01T03:22:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2023-11-01T03:22:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-11-01T03:22:33.341 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94533831883264 err -107 2023-11-01T03:22:33.341 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (7132 ms) 2023-11-01T03:22:33.341 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2023-11-01T03:22:33.341 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-11-01T03:22:33.341 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94533831883264 err -107 2023-11-01T03:22:33.342 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (32692 ms) 2023-11-01T03:22:33.342 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2023-11-01T03:22:33.342 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 347892350976 cookie 94533834259552 2023-11-01T03:22:33.342 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (10122 ms) 2023-11-01T03:22:33.342 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 356482285569 cookie 94533834259552 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (241 ms) 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 356482285570 cookie 94533834285440 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (1053 ms) 2023-11-01T03:22:33.343 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 356482285568 cookie 94533834285440 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 356482285568 cookie 94533834339664 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (469 ms) 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 356482285569 cookie 94533834339664 2023-11-01T03:22:33.344 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 360777252866 cookie 94533834339664 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3428 ms) 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94533834285440 err -107 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_cb from 4400 notify_id 365072220161 cookie 94533834285440 2023-11-01T03:22:33.345 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (7192 ms) 2023-11-01T03:22:33.346 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2023-11-01T03:22:33.346 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2023-11-01T03:22:33.346 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94533834340704 err -107 2023-11-01T03:22:33.346 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (2996 ms) 2023-11-01T03:22:33.346 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (86740 ms total) 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: watch_notify_test_cb 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (6372 ms) 2023-11-01T03:22:33.347 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (6372 ms total) 2023-11-01T03:22:33.348 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: 2023-11-01T03:22:33.348 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [----------] Global test environment tear-down 2023-11-01T03:22:33.348 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (146137 ms total) 2023-11-01T03:22:33.348 INFO:tasks.workunit.client.0.smithi005.stdout: api_watch_notify: [ PASSED ] 11 tests. 2023-11-01T03:22:33.349 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: Running main() from gmock_main.cc 2023-11-01T03:22:33.349 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2023-11-01T03:22:33.349 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] Global test environment set-up. 2023-11-01T03:22:33.349 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] 8 tests from LibRadosLock 2023-11-01T03:22:33.349 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (34906 ms) 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.LockShared (10123 ms) 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (14618 ms) 2023-11-01T03:22:33.350 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (11035 ms) 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (1099 ms) 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.Unlock (156 ms) 2023-11-01T03:22:33.351 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2023-11-01T03:22:33.352 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (422 ms) 2023-11-01T03:22:33.352 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2023-11-01T03:22:33.352 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (454 ms) 2023-11-01T03:22:33.352 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] 8 tests from LibRadosLock (72814 ms total) 2023-11-01T03:22:33.352 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (6133 ms) 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (3894 ms) 2023-11-01T03:22:33.353 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1110 ms) 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1731 ms) 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (614 ms) 2023-11-01T03:22:33.354 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (635 ms) 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (522 ms) 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (105 ms) 2023-11-01T03:22:33.355 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (14744 ms total) 2023-11-01T03:22:33.356 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: 2023-11-01T03:22:33.356 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [----------] Global test environment tear-down 2023-11-01T03:22:33.356 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (146289 ms total) 2023-11-01T03:22:33.356 INFO:tasks.workunit.client.0.smithi005.stdout: api_lock: [ PASSED ] 16 tests. 2023-11-01T03:22:33.356 INFO:tasks.workunit.client.0.smithi005.stdout:ripPP2 (263 ms) 2023-11-01T03:22:33.357 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-11-01T03:22:33.357 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (1936 ms) 2023-11-01T03:22:33.357 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2023-11-01T03:22:33.357 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (267 ms) 2023-11-01T03:22:33.357 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-11-01T03:22:33.358 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (254 ms) 2023-11-01T03:22:33.358 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2023-11-01T03:22:33.358 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (429 ms) 2023-11-01T03:22:33.358 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2023-11-01T03:22:33.358 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (147 ms) 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (198 ms) 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (316 ms) 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2023-11-01T03:22:33.359 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (375 ms) 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (346 ms) 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (1532 ms) 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2023-11-01T03:22:33.360 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (295 ms) 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (384 ms) 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (14067 ms total) 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [----------] Global test environment tear-down 2023-11-01T03:22:33.361 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (146330 ms total) 2023-11-01T03:22:33.362 INFO:tasks.workunit.client.0.smithi005.stdout: api_io_pp: [ PASSED ] 37 tests. 2023-11-01T03:23:10.406 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: Running main() from gmock_main.cc 2023-11-01T03:23:10.407 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2023-11-01T03:23:10.407 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] Global test environment set-up. 2023-11-01T03:23:10.407 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2023-11-01T03:23:10.407 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2023-11-01T03:23:10.407 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (17298 ms) 2023-11-01T03:23:10.408 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2023-11-01T03:23:10.408 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (13675 ms) 2023-11-01T03:23:10.408 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2023-11-01T03:23:10.408 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (7788 ms) 2023-11-01T03:23:10.408 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2023-11-01T03:23:10.409 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (8155 ms) 2023-11-01T03:23:10.409 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (46916 ms total) 2023-11-01T03:23:10.409 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: 2023-11-01T03:23:10.409 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2023-11-01T03:23:10.410 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2023-11-01T03:23:10.410 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (10097 ms) 2023-11-01T03:23:10.410 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2023-11-01T03:23:10.410 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (27891 ms) 2023-11-01T03:23:10.411 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2023-11-01T03:23:10.411 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (51509 ms) 2023-11-01T03:23:10.411 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (89498 ms total) 2023-11-01T03:23:10.411 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: 2023-11-01T03:23:10.411 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4176 ms) 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2043 ms) 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2023-11-01T03:23:10.412 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (3342 ms) 2023-11-01T03:23:10.413 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2023-11-01T03:23:10.413 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2975 ms) 2023-11-01T03:23:10.413 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (12536 ms total) 2023-11-01T03:23:10.413 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: 2023-11-01T03:23:10.413 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2023-11-01T03:23:10.414 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2023-11-01T03:23:10.414 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (6814 ms) 2023-11-01T03:23:10.414 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-11-01T03:23:10.414 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (5793 ms) 2023-11-01T03:23:10.415 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (12607 ms total) 2023-11-01T03:23:10.415 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: 2023-11-01T03:23:10.415 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [----------] Global test environment tear-down 2023-11-01T03:23:10.415 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (183260 ms total) 2023-11-01T03:23:10.415 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots: [ PASSED ] 13 tests. 2023-11-01T03:23:17.463 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:18.773 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.478 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:18.788 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.481 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:18.790 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.495 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:18.766 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.500 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:18.771 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.519 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:18.829 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.624 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:18.895 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.639 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:18.949 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:17.648 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:18.958 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.514 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:38.823 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.593 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:38.902 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.623 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:38.895 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.629 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:38.900 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.658 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:38.968 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.661 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:38.971 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.671 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:38.981 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.702 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:38.974 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:37.714 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:39.024 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:43.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2023-11-01T03:23:43.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [==========] Running 19 tests from 4 test suites. 2023-11-01T03:23:43.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2023-11-01T03:23:43.115 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: seed 92007 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (17302 ms) 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (31755 ms) 2023-11-01T03:23:43.116 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2023-11-01T03:23:43.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (19067 ms) 2023-11-01T03:23:43.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2023-11-01T03:23:43.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (22550 ms) 2023-11-01T03:23:43.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2023-11-01T03:23:43.117 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (34272 ms) 2023-11-01T03:23:43.118 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (124946 ms total) 2023-11-01T03:23:43.118 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: 2023-11-01T03:23:43.118 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2023-11-01T03:23:43.118 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2023-11-01T03:23:43.118 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (8232 ms) 2023-11-01T03:23:43.119 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-11-01T03:23:43.119 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (6747 ms) 2023-11-01T03:23:43.119 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-11-01T03:23:43.119 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (8133 ms) 2023-11-01T03:23:43.119 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4033 ms) 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3523 ms) 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6776-g420cd129/rpm/el9/BUILD/ceph-18.0.0-6776-g420cd129/src/test/librados/snapshots_cxx.cc:463: Skipped 2023-11-01T03:23:43.120 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi005-92007-7 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: waiting for snaps to purge 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17821 ms) 2023-11-01T03:23:43.121 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (48489 ms total) 2023-11-01T03:23:43.122 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: 2023-11-01T03:23:43.122 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2023-11-01T03:23:43.122 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2023-11-01T03:23:43.122 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (4537 ms) 2023-11-01T03:23:43.122 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2287 ms) 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2417 ms) 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (3055 ms) 2023-11-01T03:23:43.123 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (12296 ms total) 2023-11-01T03:23:43.124 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: 2023-11-01T03:23:43.124 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2023-11-01T03:23:43.124 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN api_aio: Running main() from gmock_main.cc 2023-11-01T03:23:43.124 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] Global test environment set-up. 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.TooBig (4177 ms) 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-11-01T03:23:43.125 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (29892 ms) 2023-11-01T03:23:43.126 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-11-01T03:23:43.126 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (5616 ms) 2023-11-01T03:23:43.126 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2023-11-01T03:23:43.126 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (6858 ms) 2023-11-01T03:23:43.126 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2023-11-01T03:23:43.127 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (16523 ms) 2023-11-01T03:23:43.127 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2023-11-01T03:23:43.127 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (24151 ms) 2023-11-01T03:23:43.127 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2023-11-01T03:23:43.127 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (31184 ms) 2023-11-01T03:23:43.128 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2023-11-01T03:23:43.128 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (21360 ms) 2023-11-01T03:23:43.128 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2023-11-01T03:23:43.128 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (9824 ms) 2023-11-01T03:23:43.128 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (4232 ms) 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (4353 ms) 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3933 ms) 2023-11-01T03:23:43.129 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2023-11-01T03:23:43.130 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (4026 ms) 2023-11-01T03:23:43.130 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2023-11-01T03:23:43.130 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3975 ms) 2023-11-01T03:23:43.130 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2023-11-01T03:23:43.130 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.Flush (4384 ms) 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3971 ms) 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3855 ms) 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2023-11-01T03:23:43.131 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (4223 ms) 2023-11-01T03:23:43.132 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2023-11-01T03:23:43.132 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3758 ms) 2023-11-01T03:23:43.132 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2023-11-01T03:23:43.132 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3445 ms) 2023-11-01T03:23:43.132 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2023-11-01T03:23:43.133 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2790 ms) 2023-11-01T03:23:43.133 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2023-11-01T03:23:43.133 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (4324 ms) 2023-11-01T03:23:43.133 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2023-11-01T03:23:43.133 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3599 ms) 2023-11-01T03:23:43.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2023-11-01T03:23:43.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (4408 ms) 2023-11-01T03:23:43.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2023-11-01T03:23:43.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2825 ms) 2023-11-01T03:23:43.134 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2023-11-01T03:23:43.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (4424 ms) 2023-11-01T03:23:43.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] 26 tests from LibRadosAio (216111 ms total) 2023-11-01T03:23:43.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: 2023-11-01T03:23:43.135 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2023-11-01T03:23:49.782 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleW api_aio_pp: Running main() from gmock_main.cc 2023-11-01T03:23:49.783 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2023-11-01T03:23:49.783 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] Global test environment set-up. 2023-11-01T03:23:49.783 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2023-11-01T03:23:49.783 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2023-11-01T03:23:49.784 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (4152 ms) 2023-11-01T03:23:49.784 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2023-11-01T03:23:49.784 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (36598 ms) 2023-11-01T03:23:49.784 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2023-11-01T03:23:49.784 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (15911 ms) 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (8607 ms) 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (13472 ms) 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2023-11-01T03:23:49.785 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (22950 ms) 2023-11-01T03:23:49.786 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2023-11-01T03:23:49.786 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (31147 ms) 2023-11-01T03:23:49.786 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2023-11-01T03:23:49.786 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (15726 ms) 2023-11-01T03:23:49.786 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2023-11-01T03:23:49.787 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3130 ms) 2023-11-01T03:23:49.787 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2023-11-01T03:23:49.787 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (4362 ms) 2023-11-01T03:23:49.787 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2023-11-01T03:23:49.787 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (4056 ms) 2023-11-01T03:23:49.788 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2023-11-01T03:23:49.788 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (4090 ms) 2023-11-01T03:23:49.788 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2023-11-01T03:23:49.788 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (4034 ms) 2023-11-01T03:23:49.788 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3998 ms) 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (4067 ms) 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3976 ms) 2023-11-01T03:23:49.789 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2023-11-01T03:23:49.790 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (4261 ms) 2023-11-01T03:23:49.790 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2023-11-01T03:23:49.790 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (4050 ms) 2023-11-01T03:23:49.790 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2023-11-01T03:23:49.790 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (4096 ms) 2023-11-01T03:23:49.791 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2023-11-01T03:23:49.791 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3858 ms) 2023-11-01T03:23:49.791 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2023-11-01T03:23:49.791 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3307 ms) 2023-11-01T03:23:49.791 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2023-11-01T03:23:49.792 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3472 ms) 2023-11-01T03:23:49.792 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2023-11-01T03:23:49.792 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3475 ms) 2023-11-01T03:23:49.792 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2023-11-01T03:23:49.792 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (4793 ms) 2023-11-01T03:23:49.793 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2023-11-01T03:23:49.793 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (4465 ms) 2023-11-01T03:23:49.793 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2023-11-01T03:23:49.793 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3220 ms) 2023-11-01T03:23:49.793 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2023-11-01T03:23:57.602 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:58.912 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.654 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:58.925 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.658 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:58.929 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.670 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:58.980 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.731 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:05:59.002 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.748 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:05:59.057 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.782 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:59.091 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.801 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:59.111 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:57.878 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:05:59.187 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:23:59.668 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRad ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-11-01T03:23:59.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (5115 ms) 2023-11-01T03:23:59.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-11-01T03:23:59.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4253 ms) 2023-11-01T03:23:59.669 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-11-01T03:23:59.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4240 ms) 2023-11-01T03:23:59.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (13608 ms total) 2023-11-01T03:23:59.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: 2023-11-01T03:23:59.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2023-11-01T03:23:59.670 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [==========] 19 tests from 4 test suites ran. (232493 ms total) 2023-11-01T03:23:59.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2023-11-01T03:23:59.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2023-11-01T03:23:59.671 INFO:tasks.workunit.client.0.smithi005.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-01T03:24:17.561 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:18.870 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.627 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:18.936 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.634 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:18.906 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.643 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:18.915 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.693 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:19.002 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.701 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:19.011 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.707 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:18.978 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.757 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:19.067 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:17.766 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:19.076 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:37.926 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:39.235 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:37.933 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:39.243 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:37.970 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:39.279 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:37.985 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:39.256 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:37.986 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:39.257 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:38.007 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:06:39.317 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:38.014 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:39.323 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:38.046 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:06:39.317 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:38.088 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:06:39.398 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:24:49.911 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: Running main() from gmock_main.cc 2023-11-01T03:24:49.911 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2023-11-01T03:24:49.911 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] Global test environment set-up. 2023-11-01T03:24:49.911 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2023-11-01T03:24:49.912 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2023-11-01T03:24:49.912 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2023-11-01T03:24:49.912 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2023-11-01T03:24:49.912 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: 2023-11-01T03:24:49.912 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (24669 ms) 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (21646 ms) 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2023-11-01T03:24:49.913 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (22114 ms) 2023-11-01T03:24:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2023-11-01T03:24:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (22274 ms) 2023-11-01T03:24:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2023-11-01T03:24:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (30922 ms) 2023-11-01T03:24:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2023-11-01T03:24:49.915 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (21983 ms) 2023-11-01T03:24:49.915 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2023-11-01T03:24:49.915 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (139000 ms) 2023-11-01T03:24:49.915 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (282608 ms total) 2023-11-01T03:24:49.915 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: 2023-11-01T03:24:49.916 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [----------] Global test environment tear-down 2023-11-01T03:24:49.916 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (282608 ms total) 2023-11-01T03:24:49.916 INFO:tasks.workunit.client.0.smithi005.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2023-11-01T03:24:59.688 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=6:b29083e3:::5:head expected=6:b29083e3:::5:head 2023-11-01T03:24:59.688 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:b29083e3:::5:head -> 5 2023-11-01T03:24:59.689 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=5 expected=5 2023-11-01T03:24:59.689 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:89d3ae78:::11:head 2023-11-01T03:24:59.689 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:89d3ae78:::11:head expected=6:89d3ae78:::11:head 2023-11-01T03:24:59.689 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2023-11-01T03:24:59.689 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=11 expected=11 2023-11-01T03:24:59.690 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:863748b0:::15:head 2023-11-01T03:24:59.690 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:863748b0:::15:head expected=6:863748b0:::15:head 2023-11-01T03:24:59.690 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:863748b0:::15:head -> 15 2023-11-01T03:24:59.690 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=15 expected=15 2023-11-01T03:24:59.691 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:52ea6a34:::10:head 2023-11-01T03:24:59.691 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:52ea6a34:::10:head expected=6:52ea6a34:::10:head 2023-11-01T03:24:59.691 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2023-11-01T03:24:59.691 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=10 expected=10 2023-11-01T03:24:59.691 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:5c6b0b28:::7:head expected=6:5c6b0b28:::7:head 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=7 expected=7 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:566253c9:::13:head 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:566253c9:::13:head expected=6:566253c9:::13:head 2023-11-01T03:24:59.692 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:566253c9:::13:head -> 13 2023-11-01T03:24:59.693 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=13 expected=13 2023-11-01T03:24:59.693 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:6cac518f:::0:head 2023-11-01T03:24:59.693 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:6cac518f:::0:head expected=6:6cac518f:::0:head 2023-11-01T03:24:59.693 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:6cac518f:::0:head -> 0 2023-11-01T03:24:59.694 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=0 expected=0 2023-11-01T03:24:59.694 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : seek to 6:62a1935d:::14:head 2023-11-01T03:24:59.694 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : cursor()=6:62a1935d:::14:head expected=6:62a1935d:::14:head 2023-11-01T03:24:59.694 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: > 6:62a1935d:::14:head -> 14 2023-11-01T03:24:59.694 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: : entry=14 expected=14 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (16137 ms) 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (133613 ms) 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: split 0/5 -> MIN 6:33333333::::head 2023-11-01T03:24:59.695 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: split 1/5 -> 6:33333333::::head 6:66666666::::head 2023-11-01T03:24:59.696 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: split 2/5 -> 6:66666666::::head 6:99999999::::head 2023-11-01T03:24:59.696 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: split 3/5 -> 6:99999999::::head 6:cccccccc::::head 2023-11-01T03:24:59.696 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: split 4/5 -> 6:cccccccc::::head MAX 2023-11-01T03:24:59.696 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (49245 ms) 2023-11-01T03:24:59.696 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 7 tests from LibRadosList (279629 ms total) 2023-11-01T03:24:59.697 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 2023-11-01T03:24:59.697 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 3 tests from LibRadosListEC 2023-11-01T03:24:59.697 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2023-11-01T03:24:59.697 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1634 ms) 2023-11-01T03:24:59.697 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2023-11-01T03:24:59.698 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo1,foo2,foo3 2023-11-01T03:24:59.698 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo1 2023-11-01T03:24:59.698 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo2 2023-11-01T03:24:59.698 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo3 2023-11-01T03:24:59.698 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo1,foo4,foo5 2023-11-01T03:24:59.699 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo4 2023-11-01T03:24:59.699 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo5 2023-11-01T03:24:59.699 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo1 2023-11-01T03:24:59.699 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset foo6,foo7 2023-11-01T03:24:59.699 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo7 2023-11-01T03:24:59.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: foo6 2023-11-01T03:24:59.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-11-01T03:24:59.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo4 2023-11-01T03:24:59.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo5 2023-11-01T03:24:59.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns2:foo7 2023-11-01T03:24:59.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns2:foo6 2023-11-01T03:24:59.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: ns1:foo1 2023-11-01T03:24:59.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo1 2023-11-01T03:24:59.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo2 2023-11-01T03:24:59.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: :foo3 2023-11-01T03:24:59.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (2652 ms) 2023-11-01T03:24:59.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2023-11-01T03:24:59.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 1 0 2023-11-01T03:24:59.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 10 0 2023-11-01T03:24:59.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 13 0 2023-11-01T03:25:02.857 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:04.166 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.860 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:04.170 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.910 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:04.181 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.912 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:04.183 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.916 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:04.226 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.919 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:04.229 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.922 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:04.232 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:02.963 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:04.235 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:03.034 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:04.344 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:07.678 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 7 0 2023-11-01T03:25:07.679 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 14 0 2023-11-01T03:25:07.679 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 0 0 2023-11-01T03:25:07.679 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 15 0 2023-11-01T03:25:07.679 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 11 0 2023-11-01T03:25:07.679 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 5 0 2023-11-01T03:25:07.680 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 8 0 2023-11-01T03:25:07.680 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 6 0 2023-11-01T03:25:07.680 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 3 0 2023-11-01T03:25:07.680 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 4 0 2023-11-01T03:25:07.681 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 12 0 2023-11-01T03:25:07.681 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 9 0 2023-11-01T03:25:07.681 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 2 0 2023-11-01T03:25:07.681 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-11-01T03:25:07.681 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (2808 ms) 2023-11-01T03:25:07.682 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 3 tests from LibRadosListEC (7094 ms total) 2023-11-01T03:25:07.682 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 2023-11-01T03:25:07.682 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 1 test from LibRadosListNP 2023-11-01T03:25:07.682 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2023-11-01T03:25:07.682 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3468 ms) 2023-11-01T03:25:07.683 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] 1 test from LibRadosListNP (3468 ms total) 2023-11-01T03:25:07.683 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: 2023-11-01T03:25:07.683 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [----------] Global test environment tear-down 2023-11-01T03:25:07.683 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [==========] 11 tests from 3 test suites ran. (300610 ms total) 2023-11-01T03:25:07.683 INFO:tasks.workunit.client.0.smithi005.stdout: api_list: [ PASSED ] 11 tests. 2023-11-01T03:25:09.007 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2023-11-01T03:25:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] Global test environment set-up. 2023-11-01T03:25:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2023-11-01T03:25:09.008 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2023-11-01T03:25:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2023-11-01T03:25:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-01T03:25:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2023-11-01T03:25:09.009 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: seed 91829 2023-11-01T03:25:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2023-11-01T03:25:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (22 ms) 2023-11-01T03:25:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2023-11-01T03:25:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (33233 ms) 2023-11-01T03:25:09.010 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2023-11-01T03:25:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (12231 ms) 2023-11-01T03:25:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2023-11-01T03:25:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (19495 ms) 2023-11-01T03:25:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2023-11-01T03:25:09.011 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (6521 ms) 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (252 ms) 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (172 ms) 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2023-11-01T03:25:09.012 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1300 ms) 2023-11-01T03:25:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2023-11-01T03:25:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (96 ms) 2023-11-01T03:25:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2023-11-01T03:25:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (1843 ms) 2023-11-01T03:25:09.013 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2023-11-01T03:25:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (56 ms) 2023-11-01T03:25:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2023-11-01T03:25:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (186 ms) 2023-11-01T03:25:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2023-11-01T03:25:09.014 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (292 ms) 2023-11-01T03:25:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2023-11-01T03:25:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: osd_max_attr_size = 0 2023-11-01T03:25:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2023-11-01T03:25:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (128788 ms) 2023-11-01T03:25:09.015 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (9863 ms) 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: waiting for initial deep scrubs... 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: done waiting, doing copies 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: waiting for final deep scrubs... 2023-11-01T03:25:09.016 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: done waiting 2023-11-01T03:25:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (77916 ms) 2023-11-01T03:25:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2023-11-01T03:25:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (100 ms) 2023-11-01T03:25:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2023-11-01T03:25:09.017 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (183 ms) 2023-11-01T03:25:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2023-11-01T03:25:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4194 ms) 2023-11-01T03:25:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2023-11-01T03:25:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2023-11-01T03:25:09.018 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2023-11-01T03:25:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2023-11-01T03:25:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2023-11-01T03:25:09.019 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2023-11-01T03:25:15.274 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:16.584 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.330 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:16.639 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.398 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:16.708 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.410 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:16.682 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.413 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:16.723 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.419 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:16.729 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.425 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:16.697 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.474 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:16.746 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:15.490 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:16.800 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.935 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:24.244 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.938 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:24.247 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.963 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:24.273 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.983 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:24.255 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.986 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:24.257 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.987 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:24.297 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:22.990 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:24.300 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:23.010 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:24.281 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:23.016 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:24.326 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:40.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (296743 ms total) 2023-11-01T03:25:40.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2023-11-01T03:25:40.395 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (3053 ms) 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (3053 ms total) 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2023-11-01T03:25:40.396 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (227 ms) 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (219 ms) 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (446 ms total) 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2023-11-01T03:25:40.397 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (954 ms) 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (47 ms) 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (1001 ms total) 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.398 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (389 ms) 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (71 ms) 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (460 ms total) 2023-11-01T03:25:40.399 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1511 ms) 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1511 ms total) 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: 2023-11-01T03:25:40.400 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [----------] Global test environment tear-down 2023-11-01T03:25:40.401 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (333275 ms total) 2023-11-01T03:25:40.401 INFO:tasks.workunit.client.0.smithi005.stdout: api_misc_pp: [ PASSED ] 31 tests. 2023-11-01T03:25:43.188 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:44.498 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.196 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:44.506 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.226 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:44.536 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.231 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:44.541 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.248 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:07:44.558 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.268 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:44.539 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.271 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:44.542 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.280 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:07:44.590 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:43.346 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:07:44.617 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:25:46.453 INFO:tasks.workunit.client.0.smithi005.stdout:rite 2023-11-01T03:25:46.453 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7719 ms) 2023-11-01T03:25:46.454 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2023-11-01T03:25:46.454 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6740 ms) 2023-11-01T03:25:46.454 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2023-11-01T03:25:46.454 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (12268 ms) 2023-11-01T03:25:46.454 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2023-11-01T03:25:46.455 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7397 ms) 2023-11-01T03:25:46.455 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2023-11-01T03:25:46.455 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7859 ms) 2023-11-01T03:25:46.455 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2023-11-01T03:25:46.455 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6785 ms) 2023-11-01T03:25:46.456 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2023-11-01T03:25:46.456 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7159 ms) 2023-11-01T03:25:46.456 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2023-11-01T03:25:46.456 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7563 ms) 2023-11-01T03:25:46.456 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2023-11-01T03:25:46.457 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6537 ms) 2023-11-01T03:25:46.457 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2023-11-01T03:25:46.457 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6836 ms) 2023-11-01T03:25:46.457 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2023-11-01T03:25:46.457 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7636 ms) 2023-11-01T03:25:46.458 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2023-11-01T03:25:46.458 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6609 ms) 2023-11-01T03:25:46.458 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2023-11-01T03:25:46.458 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7008 ms) 2023-11-01T03:25:46.458 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2023-11-01T03:25:46.459 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (9351 ms) 2023-11-01T03:25:46.459 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2023-11-01T03:25:46.459 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6780 ms) 2023-11-01T03:25:46.459 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2023-11-01T03:25:46.459 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (9086 ms) 2023-11-01T03:25:46.460 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (123333 ms total) 2023-11-01T03:25:46.460 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: 2023-11-01T03:25:46.460 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [----------] Global test environment tear-down 2023-11-01T03:25:46.460 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (339444 ms total) 2023-11-01T03:25:46.460 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio: [ PASSED ] 42 tests. 2023-11-01T03:26:03.137 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:04.446 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.141 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:04.451 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.191 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:04.462 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.195 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:04.466 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.203 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:04.512 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.215 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:04.525 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.218 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:04.528 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.235 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:04.507 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:03.272 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:04.581 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.349 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:24.659 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.351 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:24.661 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.389 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:24.699 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.402 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:24.673 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.403 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:24.713 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.405 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:24.715 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.406 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:24.677 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.442 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:24.752 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:23.446 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:24.717 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:28.318 INFO:tasks.workunit.client.0.smithi005.stdout:osAio.RoundTripAppendPP (3498 ms) 2023-11-01T03:26:28.319 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2023-11-01T03:26:28.319 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3733 ms) 2023-11-01T03:26:28.319 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2023-11-01T03:26:28.319 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3206 ms) 2023-11-01T03:26:28.319 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2023-11-01T03:26:28.320 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2931 ms) 2023-11-01T03:26:28.320 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2023-11-01T03:26:28.320 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: setting pool EIO 2023-11-01T03:26:28.320 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: waiting for 280 2023-11-01T03:26:28.320 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: max_success 0, min_failed 1 2023-11-01T03:26:28.321 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (8108 ms) 2023-11-01T03:26:28.321 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2023-11-01T03:26:28.321 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3457 ms) 2023-11-01T03:26:28.321 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (244206 ms total) 2023-11-01T03:26:28.322 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: 2023-11-01T03:26:28.322 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2023-11-01T03:26:28.322 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2023-11-01T03:26:28.322 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3710 ms) 2023-11-01T03:26:28.322 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2023-11-01T03:26:28.323 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (10071 ms) 2023-11-01T03:26:28.323 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2023-11-01T03:26:28.323 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (16250 ms) 2023-11-01T03:26:28.323 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2023-11-01T03:26:28.323 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3168 ms) 2023-11-01T03:26:28.324 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (33199 ms total) 2023-11-01T03:26:28.324 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: 2023-11-01T03:26:28.324 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2023-11-01T03:26:28.324 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-11-01T03:26:28.324 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3133 ms) 2023-11-01T03:26:28.325 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3133 ms total) 2023-11-01T03:26:28.325 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: 2023-11-01T03:26:28.325 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2023-11-01T03:26:28.325 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2023-11-01T03:26:28.325 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14565 ms) 2023-11-01T03:26:28.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2023-11-01T03:26:28.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6820 ms) 2023-11-01T03:26:28.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2023-11-01T03:26:28.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7391 ms) 2023-11-01T03:26:28.326 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2023-11-01T03:26:28.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7351 ms) 2023-11-01T03:26:28.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2023-11-01T03:26:28.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (4468 ms) 2023-11-01T03:26:28.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2023-11-01T03:26:28.327 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (8120 ms) 2023-11-01T03:26:28.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2023-11-01T03:26:28.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6844 ms) 2023-11-01T03:26:28.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2023-11-01T03:26:28.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7851 ms) 2023-11-01T03:26:28.328 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2023-11-01T03:26:28.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7372 ms) 2023-11-01T03:26:28.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2023-11-01T03:26:28.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (8011 ms) 2023-11-01T03:26:28.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2023-11-01T03:26:28.329 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6867 ms) 2023-11-01T03:26:28.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2023-11-01T03:26:28.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7899 ms) 2023-11-01T03:26:28.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2023-11-01T03:26:28.330 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7210 ms) 2023-11-01T03:26:43.349 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:44.658 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.360 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:44.670 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.403 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:44.675 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.408 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:44.680 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.410 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:44.719 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.415 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:44.725 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.447 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:08:44.719 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.450 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:08:44.759 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:26:43.460 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:08:44.770 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.579 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:04.889 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.591 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:04.900 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.642 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:04.914 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.645 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:04.916 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.646 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:04.956 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.649 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:04.959 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.653 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:04.963 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.687 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:04.959 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:03.694 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:05.003 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.808 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:06.079 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.811 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:06.082 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.822 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:06.132 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.829 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:06.138 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.831 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:06.102 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.907 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:06.216 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.973 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:06.283 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.975 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:06.284 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:04.991 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:06.301 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:16.824 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2023-11-01T03:27:16.824 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3339 ms) 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6690 ms) 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (8043 ms) 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2023-11-01T03:27:16.825 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7220 ms) 2023-11-01T03:27:16.826 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2023-11-01T03:27:16.826 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7249 ms) 2023-11-01T03:27:16.826 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2023-11-01T03:27:16.826 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7054 ms) 2023-11-01T03:27:16.826 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (8909 ms) 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (149273 ms total) 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [----------] Global test environment tear-down 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (429811 ms total) 2023-11-01T03:27:16.827 INFO:tasks.workunit.client.0.smithi005.stdout: api_aio_pp: [ PASSED ] 57 tests. 2023-11-01T03:27:23.594 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:24.904 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.599 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:24.909 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.633 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:24.942 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.648 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:24.920 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.651 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:24.923 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.658 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:24.968 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.664 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:24.974 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.680 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:24.952 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:23.707 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:25.016 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.703 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:50.013 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.709 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:50.018 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.712 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:49.984 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.714 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:49.986 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.717 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:50.026 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.719 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:50.028 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.812 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:50.083 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.829 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:09:50.139 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:27:48.850 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:09:50.160 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.758 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:10.067 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.760 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:10.069 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.794 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:10.104 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.806 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:10.077 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.809 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:10.118 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.809 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:10.081 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.812 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:10.122 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.841 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:10.112 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:08.845 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:10.154 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:28.949 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:30.259 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:28.953 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:30.263 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.003 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:30.312 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.018 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:30.290 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.020 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:30.291 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.020 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:30.330 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.022 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:30.332 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.064 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:30.336 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:29.071 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:30.381 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:44.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-11-01T03:28:44.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-11-01T03:28:44.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-11-01T03:28:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: seed 91895 2023-11-01T03:28:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-11-01T03:28:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (49662 ms) 2023-11-01T03:28:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-11-01T03:28:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (64431 ms) 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (142 ms) 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (114235 ms total) 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-11-01T03:28:44.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (13586 ms) 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (12959 ms) 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (18485 ms) 2023-11-01T03:28:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-11-01T03:28:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: my_snaps [4] 2023-11-01T03:28:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: my_snaps [5,4] 2023-11-01T03:28:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: my_snaps [6,5,4] 2023-11-01T03:28:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: my_snaps [7,6,5,4] 2023-11-01T03:28:44.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: promoting some heads 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: promoting from clones for snap 7 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: promoting from clones for snap 6 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: promoting from clones for snap 5 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: promoting from clones for snap 4 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: waiting for scrubs... 2023-11-01T03:28:44.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: done waiting 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (159717 ms) 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (11024 ms) 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (10195 ms) 2023-11-01T03:28:44.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-11-01T03:28:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8857 ms) 2023-11-01T03:28:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-11-01T03:28:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (9394 ms) 2023-11-01T03:28:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-11-01T03:28:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (11608 ms) 2023-11-01T03:28:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-11-01T03:28:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (10263 ms) 2023-11-01T03:28:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-11-01T03:28:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10139 ms) 2023-11-01T03:28:44.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-11-01T03:28:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (40866 ms) 2023-11-01T03:28:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-11-01T03:28:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (9881 ms) 2023-11-01T03:28:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-11-01T03:28:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (11444 ms) 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (14114 ms) 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (9136 ms) 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-11-01T03:28:44.940 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (12696 ms) 2023-11-01T03:28:48.902 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:50.212 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.905 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:50.215 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.937 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:10:50.246 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.951 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:50.222 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.953 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:50.224 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.954 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:50.264 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.957 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:50.267 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.981 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:10:50.253 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:28:48.988 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:10:50.298 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:07.700 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-11-01T03:29:07.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: hmm, no HitSet yet 2023-11-01T03:29:07.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: ok, hit_set contains 200:602f83fe:::foo:head 2023-11-01T03:29:07.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (10142 ms) 2023-11-01T03:29:07.701 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-11-01T03:29:07.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg_num = 32 2023-11-01T03:29:07.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 0 ls 1698809342,0 2023-11-01T03:29:07.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 1 ls 1698809342,0 2023-11-01T03:29:07.702 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 2 ls 1698809342,0 2023-11-01T03:29:07.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 3 ls 1698809342,0 2023-11-01T03:29:07.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 4 ls 1698809342,0 2023-11-01T03:29:07.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 5 ls 1698809342,0 2023-11-01T03:29:07.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 6 ls 1698809342,0 2023-11-01T03:29:07.703 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 7 ls 1698809342,0 2023-11-01T03:29:07.704 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 8 ls 1698809342,0 2023-11-01T03:29:07.704 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 9 ls 1698809342,0 2023-11-01T03:29:07.704 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 10 ls 1698809342,0 2023-11-01T03:29:07.704 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 11 ls 1698809342,0 2023-11-01T03:29:07.704 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 12 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 13 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 14 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 15 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 16 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 17 ls 1698809342,0 2023-11-01T03:29:07.705 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 18 ls 1698809342,0 2023-11-01T03:29:07.706 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 19 ls 1698809342,0 2023-11-01T03:29:07.706 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 20 ls 1698809342,0 2023-11-01T03:29:07.706 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 21 ls 1698809342,0 2023-11-01T03:29:07.706 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 22 ls 1698809342,0 2023-11-01T03:29:07.706 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 23 ls 1698809342,0 2023-11-01T03:29:07.707 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 24 ls 1698809342,0 2023-11-01T03:29:07.707 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 25 ls 1698809342,0 2023-11-01T03:29:07.707 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 26 ls 1698809342,0 2023-11-01T03:29:07.707 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 27 ls 1698809342,0 2023-11-01T03:29:07.707 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 28 ls 1698809342,0 2023-11-01T03:29:07.708 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 29 ls 1698809342,0 2023-11-01T03:29:07.708 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 30 ls 1698809342,0 2023-11-01T03:29:07.708 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg 31 ls 1698809342,0 2023-11-01T03:29:07.708 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: pg_num = 32 2023-11-01T03:29:07.708 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6cac518f:::0:head 2023-11-01T03:29:07.709 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:02547ec2:::1:head 2023-11-01T03:29:07.709 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f905c69b:::2:head 2023-11-01T03:29:07.709 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:cfc208b3:::3:head 2023-11-01T03:29:07.709 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d83876eb:::4:head 2023-11-01T03:29:07.709 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b29083e3:::5:head 2023-11-01T03:29:07.710 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c4fdafeb:::6:head 2023-11-01T03:29:07.710 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:5c6b0b28:::7:head 2023-11-01T03:29:07.710 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:bd63b0f1:::8:head 2023-11-01T03:29:07.710 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e960b815:::9:head 2023-11-01T03:29:07.710 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:52ea6a34:::10:head 2023-11-01T03:29:07.711 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:89d3ae78:::11:head 2023-11-01T03:29:07.711 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:de5d7c5f:::12:head 2023-11-01T03:29:07.711 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:566253c9:::13:head 2023-11-01T03:29:07.711 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:62a1935d:::14:head 2023-11-01T03:29:07.711 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:863748b0:::15:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3958e169:::16:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4d4dabf9:::17:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:8391935d:::18:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:28883081:::19:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:69259c59:::20:head 2023-11-01T03:29:07.712 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4bdb80b7:::21:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a11c5d71:::22:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:271af37b:::23:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:95b121be:::24:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:58d1031b:::25:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:0a050783:::26:head 2023-11-01T03:29:07.713 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c709704c:::27:head 2023-11-01T03:29:07.714 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:cbe56eaf:::28:head 2023-11-01T03:29:07.714 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:86b4b162:::29:head 2023-11-01T03:29:07.714 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:70d89383:::30:head 2023-11-01T03:29:07.714 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:dd450c7c:::31:head 2023-11-01T03:29:07.714 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6d5729b1:::32:head 2023-11-01T03:29:07.715 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c388f3fb:::33:head 2023-11-01T03:29:07.715 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:56cfea31:::34:head 2023-11-01T03:29:07.715 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9dbc1bf7:::35:head 2023-11-01T03:29:07.715 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:40b74ccd:::36:head 2023-11-01T03:29:07.715 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4d5aaf42:::37:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:920f362c:::38:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6cc53222:::39:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9cad833f:::40:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:1ea84d41:::41:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c4480ef6:::42:head 2023-11-01T03:29:07.716 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a694361e:::43:head 2023-11-01T03:29:07.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d1bd33e9:::44:head 2023-11-01T03:29:07.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ddc2cd5d:::45:head 2023-11-01T03:29:07.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:2b782207:::46:head 2023-11-01T03:29:07.717 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7b187fca:::47:head 2023-11-01T03:29:07.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:90ecdf6f:::48:head 2023-11-01T03:29:07.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a5ed95fe:::49:head 2023-11-01T03:29:07.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ea0eaa55:::50:head 2023-11-01T03:29:07.718 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f33ef17b:::51:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a0d1b2f6:::52:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:60c5229e:::53:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:edcbc575:::54:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:102cf253:::55:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:efb7fb0b:::56:head 2023-11-01T03:29:07.719 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:50d0a326:::57:head 2023-11-01T03:29:07.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d4dc5daf:::58:head 2023-11-01T03:29:07.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3a130462:::59:head 2023-11-01T03:29:07.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ec87ed71:::60:head 2023-11-01T03:29:07.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d5bc9454:::61:head 2023-11-01T03:29:07.720 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3ddfe313:::62:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7c2816b9:::63:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:47e00e4d:::64:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c6410c18:::65:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b48ed237:::66:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:cd63ad31:::67:head 2023-11-01T03:29:07.721 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b179e92b:::68:head 2023-11-01T03:29:07.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:0d9f741a:::69:head 2023-11-01T03:29:07.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6d3352ae:::70:head 2023-11-01T03:29:07.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c6d5c19e:::71:head 2023-11-01T03:29:07.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:bc4729c3:::72:head 2023-11-01T03:29:07.722 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:77e930b9:::73:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:0abeecfd:::74:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b7c37e15:::75:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b6378398:::76:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:02bd68de:::77:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:cc795d2d:::78:head 2023-11-01T03:29:07.723 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:630d4fea:::79:head 2023-11-01T03:29:07.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e0d29ef5:::80:head 2023-11-01T03:29:07.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:fd6f13d2:::81:head 2023-11-01T03:29:07.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:606461d5:::82:head 2023-11-01T03:29:07.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:eadbdc43:::83:head 2023-11-01T03:29:07.724 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:8761d0bb:::84:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9ef0186f:::85:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e0d41294:::86:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:961de695:::87:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:1423148f:::88:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:633a8fa2:::89:head 2023-11-01T03:29:07.725 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a8653809:::90:head 2023-11-01T03:29:07.726 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3dac8b33:::91:head 2023-11-01T03:29:07.726 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:35aad435:::92:head 2023-11-01T03:29:07.726 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f6dcc343:::93:head 2023-11-01T03:29:07.726 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:dbbdad87:::94:head 2023-11-01T03:29:07.726 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:1cb48ce0:::95:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:03cd461c:::96:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:17a4ea99:::97:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9993c9a7:::98:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6394211c:::99:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:94c7ae57:::100:head 2023-11-01T03:29:07.727 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6fdee5bb:::101:head 2023-11-01T03:29:07.728 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9a477fd1:::102:head 2023-11-01T03:29:07.728 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:eb850916:::103:head 2023-11-01T03:29:07.728 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:affc56b9:::104:head 2023-11-01T03:29:07.728 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b42dc814:::105:head 2023-11-01T03:29:07.729 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f319f8f0:::106:head 2023-11-01T03:29:07.729 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9a40b9de:::107:head 2023-11-01T03:29:07.729 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:8b524f28:::108:head 2023-11-01T03:29:07.729 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e3de589f:::109:head 2023-11-01T03:29:07.730 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:90f90a5b:::110:head 2023-11-01T03:29:07.730 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a7b4f1d7:::111:head 2023-11-01T03:29:07.730 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:af51766e:::112:head 2023-11-01T03:29:07.730 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b6f90bd1:::113:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e0261208:::114:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c9569ef7:::115:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:61bebe50:::116:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:fe93412b:::117:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d3d38bee:::118:head 2023-11-01T03:29:07.731 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3100ba0c:::119:head 2023-11-01T03:29:07.732 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d0560ada:::120:head 2023-11-01T03:29:07.732 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f0ea8b35:::121:head 2023-11-01T03:29:07.732 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:766f231a:::122:head 2023-11-01T03:29:07.732 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a07a2582:::123:head 2023-11-01T03:29:07.732 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:bd7c6b3a:::124:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:fb2ddaff:::125:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4408e1fe:::126:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ee1df7a7:::127:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c3002909:::128:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4f48ffa9:::129:head 2023-11-01T03:29:07.733 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:edf38733:::130:head 2023-11-01T03:29:07.734 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c08425c0:::131:head 2023-11-01T03:29:07.734 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:5f902d98:::132:head 2023-11-01T03:29:07.734 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:41ea2c93:::133:head 2023-11-01T03:29:07.734 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:813cee13:::134:head 2023-11-01T03:29:07.734 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:0131818d:::135:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:26ba5a85:::136:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:381b8a5a:::137:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:28797e47:::138:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:bfca7f22:::139:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:36807075:::140:head 2023-11-01T03:29:07.735 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:80b03975:::141:head 2023-11-01T03:29:07.736 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:5c15709b:::142:head 2023-11-01T03:29:07.736 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f39ea15e:::143:head 2023-11-01T03:29:07.736 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ea992956:::144:head 2023-11-01T03:29:07.736 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:48887b1c:::145:head 2023-11-01T03:29:07.736 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:9f24a9dd:::146:head 2023-11-01T03:29:07.737 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:987f100b:::147:head 2023-11-01T03:29:07.737 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d2dd3581:::148:head 2023-11-01T03:29:07.737 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7fed1808:::149:head 2023-11-01T03:29:07.737 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c80b70e9:::150:head 2023-11-01T03:29:07.737 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:85ed90f9:::151:head 2023-11-01T03:29:07.738 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:36428b24:::152:head 2023-11-01T03:29:07.738 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d044c34a:::153:head 2023-11-01T03:29:07.738 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7c18bf58:::154:head 2023-11-01T03:29:07.738 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d1c21232:::155:head 2023-11-01T03:29:07.738 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a7a3c575:::156:head 2023-11-01T03:29:07.739 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:87da0633:::157:head 2023-11-01T03:29:07.739 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d5ac3822:::158:head 2023-11-01T03:29:07.739 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3f20522d:::159:head 2023-11-01T03:29:07.739 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6ca26563:::160:head 2023-11-01T03:29:07.739 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:532ce135:::161:head 2023-11-01T03:29:07.740 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:c78863e6:::162:head 2023-11-01T03:29:09.007 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:10.317 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.010 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:10.320 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.041 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:10.351 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.055 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:10.327 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.058 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:10.330 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.068 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:10.377 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.071 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:10.381 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.086 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:10.358 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:09.104 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:10.414 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.564 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:15.873 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.568 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:15.878 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.592 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:15.902 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.620 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:15.891 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.623 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:15.895 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.631 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:15.941 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.635 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:15.945 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.639 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:15.911 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:14.654 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:15.964 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.106 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:30.415 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.109 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:30.418 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.147 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:30.457 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.158 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:30.429 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.158 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:30.430 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.169 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:30.479 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.173 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:30.483 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.179 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:30.451 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:29.197 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:30.506 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.225 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:50.535 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.278 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:50.588 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.307 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:11:50.616 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.321 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:50.592 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.324 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:50.595 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.326 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:50.635 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.327 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:50.637 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.354 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:50.625 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:29:49.369 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:11:50.679 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.231 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:10.540 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.234 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:10.544 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.279 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:10.550 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.284 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:10.556 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.288 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:10.598 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.290 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:10.600 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.294 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:10.603 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.312 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:10.583 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.325 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:10.634 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.931 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:11.202 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.932 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:11.204 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.940 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:11.211 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.965 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:11.275 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.966 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:11.276 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.974 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:11.284 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.993 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:11.302 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:09.993 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:11.303 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:10.001 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:11.311 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:15.927 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7462ddf6:::163:head 2023-11-01T03:30:15.927 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:5d165639:::164:head 2023-11-01T03:30:15.928 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f43765fc:::165:head 2023-11-01T03:30:15.928 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b4c720e9:::166:head 2023-11-01T03:30:15.928 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e694b040:::167:head 2023-11-01T03:30:15.928 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:afa38db2:::168:head 2023-11-01T03:30:15.928 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:77ba9f53:::169:head 2023-11-01T03:30:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:87495034:::170:head 2023-11-01T03:30:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7c96bf0e:::171:head 2023-11-01T03:30:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:dbe346cc:::172:head 2023-11-01T03:30:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:e943ec24:::173:head 2023-11-01T03:30:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f97a9c0c:::174:head 2023-11-01T03:30:15.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:6f26e74d:::175:head 2023-11-01T03:30:15.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4f95e106:::176:head 2023-11-01T03:30:15.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:0e6f2f8f:::177:head 2023-11-01T03:30:15.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:05db05f1:::178:head 2023-11-01T03:30:15.930 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:38a78d66:::179:head 2023-11-01T03:30:15.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:d095610b:::180:head 2023-11-01T03:30:15.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:a1a9d709:::181:head 2023-11-01T03:30:15.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:1e5d39db:::182:head 2023-11-01T03:30:15.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:f7df4fb9:::183:head 2023-11-01T03:30:15.931 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:03a7f161:::184:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ba70721e:::185:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:28e5662d:::186:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:973d52de:::187:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:4303eb1c:::188:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:b990b48e:::189:head 2023-11-01T03:30:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:29b8165b:::190:head 2023-11-01T03:30:15.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:3547f197:::191:head 2023-11-01T03:30:15.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:7e260936:::192:head 2023-11-01T03:30:15.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:1abec7b1:::193:head 2023-11-01T03:30:15.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:10fdda93:::194:head 2023-11-01T03:30:15.933 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:15817eea:::195:head 2023-11-01T03:30:15.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:770bab57:::196:head 2023-11-01T03:30:15.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:ed9e13e7:::197:head 2023-11-01T03:30:15.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:71471a8f:::198:head 2023-11-01T03:30:15.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: checking for 201:10fb1d02:::199:head 2023-11-01T03:30:15.934 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (22654 ms) 2023-11-01T03:30:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-11-01T03:30:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,0 2023-11-01T03:30:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: first is 1698809365 2023-11-01T03:30:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,0 2023-11-01T03:30:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,0 2023-11-01T03:30:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,0 2023-11-01T03:30:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,0 2023-11-01T03:30:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,0 2023-11-01T03:30:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,0 2023-11-01T03:30:15.936 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,0 2023-11-01T03:30:15.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,0 2023-11-01T03:30:15.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,1698809373,1698809374,0 2023-11-01T03:30:15.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,1698809373,1698809374,0 2023-11-01T03:30:15.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809365,1698809367,1698809368,1698809370,1698809371,1698809373,1698809374,0 2023-11-01T03:30:15.937 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809368,1698809370,1698809371,1698809373,1698809374,1698809376,1698809377,0 2023-11-01T03:30:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: first now 1698809368, trimmed 2023-11-01T03:30:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21095 ms) 2023-11-01T03:30:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-11-01T03:30:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: foo0 2023-11-01T03:30:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: verifying foo0 is eventually promoted 2023-11-01T03:30:15.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (15432 ms) 2023-11-01T03:30:15.939 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-11-01T03:30:24.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:25.694 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.390 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:25.700 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.419 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:25.729 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.433 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:25.705 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.435 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:25.706 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.439 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:25.749 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.441 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:25.751 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.463 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:25.734 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:24.471 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:25.780 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.492 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:30.801 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.537 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:30.809 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.538 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:30.810 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.544 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:30.854 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.545 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:30.855 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.546 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:30.856 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.554 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:30.825 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.562 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:30.872 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:29.564 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:30.874 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.457 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:40.767 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.476 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:40.786 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.497 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:40.807 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.509 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:40.781 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.512 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:40.783 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.513 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:40.823 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.517 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:40.826 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.529 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:40.801 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:39.530 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:40.840 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.463 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:50.773 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.466 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:50.776 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.512 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:50.784 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.515 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:50.787 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:50.829 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.527 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:50.837 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.531 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:50.841 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.540 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:50.811 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:49.554 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:50.864 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.488 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:55.798 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.492 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:55.802 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.505 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:12:55.815 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.541 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:55.812 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.541 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:55.813 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.542 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:55.852 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.543 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:55.853 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.554 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:12:55.826 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:30:54.559 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:12:55.869 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.589 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:10.899 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.606 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:10.916 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.643 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:10.914 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.644 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:10.915 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.658 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:10.968 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.663 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:10.973 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.664 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:10.974 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.672 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:10.943 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:09.745 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:11.054 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.471 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:11.742 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.472 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:11.743 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.483 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:11.754 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.565 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:11.875 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.566 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:11.876 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.585 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:11.894 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.589 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:11.899 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.594 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:11.904 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:10.604 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:11.914 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.628 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:25.937 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.699 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:26.009 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.702 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:26.012 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.702 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:26.012 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.727 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:26.037 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.727 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:26.037 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.749 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:26.021 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.752 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:26.024 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:24.772 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:26.044 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.807 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:31.117 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.812 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:31.122 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.829 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:31.139 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.864 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:31.136 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.866 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:31.138 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.868 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:31.178 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.872 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:31.182 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.881 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:31.152 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:29.891 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:31.201 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.869 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:46.179 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.873 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:46.183 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.898 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:46.208 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.921 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:46.193 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.923 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:46.195 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.926 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:46.236 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.931 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:46.241 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.939 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:46.210 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:44.951 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:46.261 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:54.959 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:56.269 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:54.963 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:56.273 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:54.984 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:13:56.294 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.009 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:56.280 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.009 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:56.319 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.011 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:56.283 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.015 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:56.325 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.033 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:13:56.304 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:31:55.037 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:13:56.347 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.139 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:06.448 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.143 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:06.452 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.181 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:06.490 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.199 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:06.470 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.203 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:06.475 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.212 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:06.522 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.216 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:06.526 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.228 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:06.499 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.240 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:06.550 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.963 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:07.235 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.965 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:07.236 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:05.977 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:07.248 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.009 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:07.319 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.010 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:07.320 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.021 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:07.331 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.081 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:07.391 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.083 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:07.392 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:06.096 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:07.406 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.174 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:16.484 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.182 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:16.492 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.217 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:16.527 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.222 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:16.493 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.227 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:16.499 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.246 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:16.556 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.248 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:16.520 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.249 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:16.559 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:15.274 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:16.584 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.233 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:36.542 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.236 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:36.546 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.268 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:36.578 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.282 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:36.554 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.285 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:36.556 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.297 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:36.607 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.302 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:36.612 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.305 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:36.577 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:35.323 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:36.632 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.254 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:46.563 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.260 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:46.570 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.279 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:46.589 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.301 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:46.573 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.303 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:46.574 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.311 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:46.621 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.312 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:46.622 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.319 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:46.591 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:45.330 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:46.640 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.302 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:56.612 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.307 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:56.617 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.322 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:14:56.632 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.354 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:56.664 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.354 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:56.626 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.355 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:56.627 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.358 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:56.668 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.369 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:14:56.641 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:32:55.373 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:14:56.683 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.501 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:01.811 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.505 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:01.815 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:01.829 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.552 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:01.862 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.554 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:01.864 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.556 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:01.828 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.559 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:01.830 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.570 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:01.880 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:00.574 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:01.845 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.542 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:16.852 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.544 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:16.854 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.583 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:16.893 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.588 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:16.859 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.589 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:16.860 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.611 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:16.921 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.613 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:16.923 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.614 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:16.886 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:15.642 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:16.952 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:34.404 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:33:34.396+0000 2328a640 -1 snap_mapper.add_oid found existing snaps mapped on 219:52bb95d5:test-rados-api-smithi005-91895-80::foo:2, removing 2023-11-01T03:33:34.422 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:33:34.413+0000 2a698640 -1 snap_mapper.add_oid found existing snaps mapped on 219:52bb95d5:test-rados-api-smithi005-91895-80::foo:2, removing 2023-11-01T03:33:35.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:36.828 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.521 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:36.831 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.540 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:36.850 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.562 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:36.833 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.566 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:36.837 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.567 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:36.876 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.568 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:36.878 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.584 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:36.855 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:35.590 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:36.900 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.022 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:37.293 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.023 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:37.294 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.031 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:37.303 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.067 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:37.376 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.068 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:37.378 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.077 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:37.387 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.123 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:37.433 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.124 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:37.434 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:36.134 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:37.444 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.687 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:51.996 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.696 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:52.005 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.696 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:51.968 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.697 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:51.969 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.702 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.012 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.704 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.014 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.770 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:52.041 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.783 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.093 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:50.820 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:52.129 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.356 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:52.627 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.357 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:52.629 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.368 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:52.640 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.392 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.702 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.393 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.703 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.405 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:52.715 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.491 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:52.801 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.492 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:52.802 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:51.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:52.814 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.645 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:56.954 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.650 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:56.960 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.665 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:15:56.975 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.706 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:56.978 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.707 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:57.016 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.709 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:56.980 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.710 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:57.020 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.722 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:56.994 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:33:55.724 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:15:57.034 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.687 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:06.996 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.688 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:06.998 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.709 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:07.018 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.736 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:07.008 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.738 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:07.009 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.743 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:07.053 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.744 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:07.054 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.759 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:07.030 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:05.769 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:07.079 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:11.837 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (21674 ms) 2023-11-01T03:34:11.837 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-11-01T03:34:11.837 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (24928 ms) 2023-11-01T03:34:11.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-11-01T03:34:11.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (4556 ms) 2023-11-01T03:34:11.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-11-01T03:34:11.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.838 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (4756 ms) 2023-11-01T03:34:11.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-11-01T03:34:11.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (4808 ms) 2023-11-01T03:34:11.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-11-01T03:34:11.839 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (4505 ms) 2023-11-01T03:34:11.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-11-01T03:34:11.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (5157 ms) 2023-11-01T03:34:11.840 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-11-01T03:34:11.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (42343 ms) 2023-11-01T03:34:11.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-11-01T03:34:11.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.841 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17648 ms) 2023-11-01T03:34:11.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-11-01T03:34:11.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (5482 ms) 2023-11-01T03:34:11.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-11-01T03:34:11.842 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (4572 ms) 2023-11-01T03:34:11.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-11-01T03:34:11.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (26906 ms) 2023-11-01T03:34:11.843 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-11-01T03:34:11.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16175 ms) 2023-11-01T03:34:11.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-11-01T03:34:11.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.844 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (6869 ms) 2023-11-01T03:34:11.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-11-01T03:34:11.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (5442 ms) 2023-11-01T03:34:11.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-11-01T03:34:11.845 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: waiting for scrubs... 2023-11-01T03:34:11.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: done waiting 2023-11-01T03:34:11.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (26093 ms) 2023-11-01T03:34:11.846 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-11-01T03:34:11.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (11076 ms) 2023-11-01T03:34:11.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-11-01T03:34:11.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.847 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (11266 ms) 2023-11-01T03:34:11.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-11-01T03:34:11.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:34:11.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (11514 ms) 2023-11-01T03:34:11.848 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-11-01T03:34:15.868 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:17.178 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.870 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:17.180 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.892 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:17.202 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.913 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:17.223 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.915 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:17.187 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.917 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:17.188 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.917 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:17.227 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.940 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:17.212 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:15.944 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:17.254 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.753 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:22.062 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.770 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:22.080 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.787 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:22.097 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.805 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:22.076 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.807 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:22.078 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.821 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:22.092 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.821 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:22.131 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.824 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:22.134 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:20.839 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:22.149 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.925 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:37.234 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.930 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:37.240 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.934 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:37.244 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.936 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:37.246 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.937 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:37.209 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:35.940 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:37.212 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:36.022 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:37.332 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:36.032 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:37.342 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:36.053 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:37.325 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:50.991 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:52.301 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:50.997 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:52.307 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.020 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:52.329 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.046 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:52.355 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.052 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:52.362 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.055 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:52.327 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.057 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:52.329 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.076 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:52.385 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:51.086 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:52.357 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.007 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:57.317 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.056 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:57.366 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.057 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:57.367 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.058 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:57.368 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.066 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:57.337 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.069 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:57.340 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.076 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:16:57.385 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.077 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:16:57.387 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:34:56.079 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:16:57.351 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.098 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:12.408 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.163 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:12.473 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.191 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:12.501 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.216 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:12.488 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.216 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:12.526 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.218 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:12.527 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.218 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:12.489 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.238 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:12.548 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:11.238 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:12.510 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.029 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:17.339 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.032 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:17.342 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.043 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:17.353 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.080 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:17.390 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.083 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:17.393 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.084 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:17.356 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.087 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:17.359 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.097 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:17.407 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:16.098 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:17.370 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:17.553 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:35:17.529+0000 2328a640 -1 snap_mapper.add_oid found existing snaps mapped on 77:c81fb0f2:test-rados-api-smithi005-91895-97::foo:31, removing 2023-11-01T03:35:17.567 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:35:17.560+0000 26a91640 -1 snap_mapper.add_oid found existing snaps mapped on 77:c81fb0f2:test-rados-api-smithi005-91895-97::foo:31, removing 2023-11-01T03:35:26.109 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:27.419 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.114 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:27.424 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.141 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:27.451 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.164 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:27.435 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.167 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:27.438 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.176 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:27.486 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.177 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:27.487 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.186 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:27.458 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:26.200 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:27.510 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.205 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:37.515 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.260 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:37.570 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.283 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:37.593 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.304 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:37.576 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.306 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:37.577 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.308 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:37.618 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.310 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:37.620 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.328 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:37.600 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:36.343 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:37.653 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.186 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:42.496 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.193 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:42.501 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.206 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:42.516 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.240 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:42.512 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.241 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:42.551 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.244 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:42.554 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.244 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:42.516 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.257 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:42.529 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:41.258 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:42.568 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.286 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:47.595 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.291 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:47.601 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.312 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:47.622 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.344 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:47.616 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.348 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:47.619 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.365 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:47.637 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.366 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:47.675 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.368 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:47.678 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:46.387 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:47.697 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.449 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:57.759 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.455 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:57.765 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.481 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:57.791 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.505 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:57.815 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.509 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:57.819 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.522 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:57.794 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.524 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:57.795 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.534 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:57.844 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:56.594 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:57.865 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.462 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:59.772 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.468 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:59.778 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.481 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:59.791 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.483 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:59.793 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.485 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:59.756 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.491 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:59.763 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.492 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:17:59.801 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.559 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:17:59.869 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:35:58.580 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:59.852 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.316 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:02.626 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.362 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:02.634 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.364 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:02.636 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.379 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:02.650 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.382 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:02.692 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.405 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:02.715 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.418 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:02.728 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.421 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:02.731 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:01.436 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:02.745 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.516 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:12.825 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:12.829 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.543 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:12.853 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.567 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:12.838 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.570 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:12.841 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.571 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:12.881 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.572 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:12.882 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.594 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:12.866 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:11.595 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:12.905 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.599 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:22.908 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.601 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:22.911 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.642 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:22.952 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.650 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:22.960 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.651 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:22.922 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.656 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:22.927 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.676 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:22.986 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.682 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:22.991 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:21.738 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:23.009 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.472 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:27.782 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.476 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:27.786 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.490 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:27.800 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.516 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:27.787 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.519 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:27.790 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.525 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:27.835 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.527 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:27.837 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.533 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:27.804 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:26.542 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:27.852 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.573 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:42.883 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.575 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:42.885 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.606 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:42.916 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.622 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:42.932 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.626 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:42.936 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.647 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:42.919 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.649 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:42.920 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.655 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:42.965 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:41.676 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:42.947 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.314 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:43.586 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.315 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:43.587 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.325 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:43.596 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.326 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:43.636 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.327 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:43.637 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.336 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:43.646 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.373 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:43.683 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.374 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:43.684 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:42.385 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:43.695 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.563 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:57.873 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.566 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:57.876 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.592 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:18:57.902 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.613 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:57.885 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.615 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:57.886 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.616 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:57.926 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.618 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:57.928 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.640 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:18:57.912 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:36:56.644 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:18:57.954 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.574 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:02.884 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.576 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:02.886 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.589 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:02.899 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.620 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:02.891 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.626 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:02.936 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.628 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:02.938 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.629 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:02.901 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.641 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:02.951 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:01.644 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:02.915 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.564 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:12.873 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.614 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:12.886 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.616 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:12.926 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.617 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:12.889 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.637 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:12.947 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.653 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:12.924 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.678 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:12.988 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.681 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:12.991 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:11.697 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:13.007 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.772 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:23.081 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.774 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:23.084 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.791 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:23.101 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.828 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:23.099 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.841 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:23.151 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.842 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:23.152 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.845 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:23.117 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.857 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:23.167 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:21.860 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:23.132 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.769 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:28.079 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.771 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:28.081 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.788 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:28.098 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.822 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:28.093 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.823 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:28.095 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.826 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:28.136 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.827 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:28.137 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.837 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:28.108 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:26.846 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:28.156 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.741 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.051 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.743 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.053 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.771 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.081 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.774 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.046 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.778 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.049 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.790 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.100 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.793 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.103 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.820 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.092 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:41.829 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.139 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.533 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.805 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.534 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.806 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.544 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:43.815 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.547 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.857 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.548 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.858 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.563 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:43.872 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.607 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.917 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.609 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.919 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:42.619 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:43.929 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.799 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:58.109 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.802 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:58.111 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.836 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:58.146 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.849 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.120 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.852 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.123 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.864 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:58.174 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.866 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:58.176 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.881 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.152 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:56.909 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:58.219 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.609 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.881 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.610 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.882 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.623 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:58.895 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.695 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:59.005 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.696 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:59.006 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.709 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:19:59.019 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.757 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:59.066 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.758 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:59.068 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:37:57.771 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:19:59.081 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.764 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:03.074 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.808 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:03.080 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.810 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:03.081 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.813 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:03.123 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.826 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:03.098 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.833 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:03.143 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.863 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:03.173 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.868 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:03.178 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:01.885 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:03.195 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:11.948 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:13.258 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:11.953 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:13.262 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:11.976 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:13.286 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:11.999 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:13.271 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.007 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:13.317 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.009 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:13.319 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.015 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:13.286 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.032 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:13.342 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.043 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:13.314 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:12.890 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.890 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (10372 ms) 2023-11-01T03:38:12.890 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-11-01T03:38:12.891 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.891 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (7866 ms) 2023-11-01T03:38:12.891 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-11-01T03:38:12.891 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.891 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (6624 ms) 2023-11-01T03:38:12.892 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-11-01T03:38:12.892 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.892 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (28218 ms) 2023-11-01T03:38:12.892 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-11-01T03:38:12.892 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.893 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (15650 ms) 2023-11-01T03:38:12.893 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-11-01T03:38:12.893 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (13757 ms) 2023-11-01T03:38:12.893 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-11-01T03:38:12.893 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2023-11-01T03:38:12.894 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 00000010 69 73 |is| 2023-11-01T03:38:12.894 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 00000012 2023-11-01T03:38:12.894 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (13096 ms) 2023-11-01T03:38:12.894 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-11-01T03:38:12.894 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: require_osd_release = reef 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (7765 ms) 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (802806 ms total) 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-11-01T03:38:12.895 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1607 ms) 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (12073 ms) 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (19572 ms) 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-11-01T03:38:12.896 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (15 ms) 2023-11-01T03:38:12.897 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (33267 ms total) 2023-11-01T03:38:12.897 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 2023-11-01T03:38:12.897 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-11-01T03:38:12.897 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-11-01T03:38:12.897 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (8524 ms) 2023-11-01T03:38:12.898 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-11-01T03:38:12.898 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (9945 ms) 2023-11-01T03:38:12.898 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-11-01T03:38:12.898 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: waiting for scrub... 2023-11-01T03:38:12.898 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: done waiting 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (27688 ms) 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10144 ms) 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (9289 ms) 2023-11-01T03:38:12.899 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-11-01T03:38:12.900 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8931 ms) 2023-11-01T03:38:12.900 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-11-01T03:38:12.900 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (11303 ms) 2023-11-01T03:38:12.900 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-11-01T03:38:21.842 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:23.152 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.887 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:23.159 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.888 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:23.160 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.891 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:23.201 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.891 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:23.201 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.892 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:23.202 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.911 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:23.183 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.917 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:23.227 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:21.921 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:23.231 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.902 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:28.212 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.907 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:28.217 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.925 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:28.235 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.951 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:28.223 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.952 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:28.224 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.956 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:28.266 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.958 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:28.268 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.964 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:28.235 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:26.971 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:28.281 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:41.965 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:43.274 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:41.968 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:43.278 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:41.996 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:43.306 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.015 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:43.286 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.016 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:43.288 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.025 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:43.335 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.029 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:43.339 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.043 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:43.315 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:42.060 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:43.370 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:46.976 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:48.285 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:46.979 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:48.289 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.000 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:48.310 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.025 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:48.296 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.026 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:48.336 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.027 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:48.298 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.030 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:48.340 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.041 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:48.313 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:47.048 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:48.358 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.124 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:58.434 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.127 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:58.437 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.150 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:20:58.460 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.175 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:58.447 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.177 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:58.449 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.192 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:58.502 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.193 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:58.503 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.200 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:20:58.472 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:38:57.217 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:20:58.527 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.248 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:08.557 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.256 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:08.566 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.291 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:08.600 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.316 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:08.625 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.317 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:08.627 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.319 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:08.590 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.322 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:08.593 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.340 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:08.650 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:07.343 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:08.614 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.119 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:13.429 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.177 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:13.487 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.193 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:13.503 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.222 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:13.532 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.223 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:13.495 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.225 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:13.497 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.226 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:13.536 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.240 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:13.511 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:12.241 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:13.551 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.356 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:28.666 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.358 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:28.668 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.393 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:28.703 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.407 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:28.678 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.408 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:28.679 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.418 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:28.728 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.420 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:28.730 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.434 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:28.706 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:27.465 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:28.775 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.266 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:48.575 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.267 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:48.577 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.292 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:48.602 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.312 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:48.584 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.314 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:48.585 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.318 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:48.627 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.319 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:48.630 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.338 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:48.609 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:47.343 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:48.653 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.110 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:49.381 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.111 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:49.383 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.120 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:21:49.391 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.201 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:49.510 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.202 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:49.512 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.211 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:21:49.521 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.272 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:49.582 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.273 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:49.583 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:48.282 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:21:49.592 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.054 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:00.364 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.057 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:00.367 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.087 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:00.397 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.112 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:00.384 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.115 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:00.425 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.118 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:00.390 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.120 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:00.430 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.150 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:00.422 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:39:59.166 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:00.476 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.407 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:08.717 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.409 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:08.719 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.426 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:08.736 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.454 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:08.726 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.456 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:08.727 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.456 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:08.765 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.458 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:08.768 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.473 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:08.744 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:07.476 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:08.786 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.101 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:09.373 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.102 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:09.374 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.110 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:09.382 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.145 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:09.455 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.146 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:09.456 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.157 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:09.467 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.181 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:09.491 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.182 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:09.492 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:08.190 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:09.500 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.461 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:23.771 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.465 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:23.775 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.490 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:23.800 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.507 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:23.779 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.510 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:23.782 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.514 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:23.824 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.517 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:23.827 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.532 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:23.803 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:22.540 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:23.850 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.480 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:28.790 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.485 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:28.795 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.505 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:28.815 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.532 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:28.803 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.535 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:28.806 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.541 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:28.851 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.543 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:28.853 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.549 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:28.820 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:27.556 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:28.866 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.512 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:38.821 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.517 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:38.827 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.537 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:38.847 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.570 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:38.842 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.572 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:38.843 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.582 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:38.892 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.585 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:38.895 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.588 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:38.859 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:37.602 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:38.912 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.541 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:48.851 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.543 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:48.854 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.564 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:48.874 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.588 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:48.859 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.589 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:48.861 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.592 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:48.902 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.598 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:48.908 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.607 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:48.879 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:47.618 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:48.928 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.559 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:53.868 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.562 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:53.872 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.578 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:22:53.888 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.605 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:53.877 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.606 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:53.878 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.613 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:53.923 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.616 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:53.926 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.621 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:22:53.892 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:40:52.637 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:22:53.947 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:06.200 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (10402 ms) 2023-11-01T03:41:06.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-11-01T03:41:06.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (14466 ms) 2023-11-01T03:41:06.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-11-01T03:41:06.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8976 ms) 2023-11-01T03:41:06.202 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-11-01T03:41:06.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (14316 ms) 2023-11-01T03:41:06.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-11-01T03:41:06.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (9063 ms) 2023-11-01T03:41:06.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-11-01T03:41:06.203 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (9911 ms) 2023-11-01T03:41:06.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-11-01T03:41:06.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: hmm, no HitSet yet 2023-11-01T03:41:06.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: ok, hit_set contains 251:602f83fe:::foo:head 2023-11-01T03:41:06.204 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9887 ms) 2023-11-01T03:41:06.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-11-01T03:41:06.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,0 2023-11-01T03:41:06.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: first is 1698809967 2023-11-01T03:41:06.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,0 2023-11-01T03:41:06.205 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,0 2023-11-01T03:41:06.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,0 2023-11-01T03:41:06.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,0 2023-11-01T03:41:06.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,0 2023-11-01T03:41:06.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,0 2023-11-01T03:41:06.206 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,0 2023-11-01T03:41:06.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,0 2023-11-01T03:41:06.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,1698809976,1698809977,0 2023-11-01T03:41:06.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,1698809976,1698809977,0 2023-11-01T03:41:06.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809967,1698809970,1698809971,1698809973,1698809974,1698809976,1698809977,0 2023-11-01T03:41:06.207 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: got ls 1698809971,1698809973,1698809974,1698809976,1698809977,1698809979,1698809980,0 2023-11-01T03:41:06.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: first now 1698809971, trimmed 2023-11-01T03:41:06.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (22483 ms) 2023-11-01T03:41:06.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-11-01T03:41:06.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: foo0 2023-11-01T03:41:06.208 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: verifying foo0 is eventually promoted 2023-11-01T03:41:06.209 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (16948 ms) 2023-11-01T03:41:06.209 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-11-01T03:41:06.209 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (19978 ms) 2023-11-01T03:41:06.209 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-11-01T03:41:06.210 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (24639 ms) 2023-11-01T03:41:06.210 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-11-01T03:41:06.210 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (6055 ms) 2023-11-01T03:41:06.210 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-11-01T03:41:06.210 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (5354 ms) 2023-11-01T03:41:06.211 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-11-01T03:41:06.211 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (4530 ms) 2023-11-01T03:41:06.211 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-11-01T03:41:06.211 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3371 ms) 2023-11-01T03:41:06.211 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (266203 ms total) 2023-11-01T03:41:06.212 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: 2023-11-01T03:41:06.212 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-11-01T03:41:06.212 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (1259053 ms total) 2023-11-01T03:41:06.212 INFO:tasks.workunit.client.0.smithi005.stdout: api_tier_pp: [ PASSED ] 77 tests. 2023-11-01T03:41:06.216 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.216 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91592 2023-11-01T03:41:06.216 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91592 2023-11-01T03:41:06.216 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.216 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91794 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91794 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92307 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92307 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92050 2023-11-01T03:41:06.218 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92050 2023-11-01T03:41:06.218 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.218 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91885 2023-11-01T03:41:06.218 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91885 2023-11-01T03:41:06.218 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91681 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91681 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91967 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91967 2023-11-01T03:41:06.219 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91713 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91713 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92200 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92200 2023-11-01T03:41:06.220 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91567 2023-11-01T03:41:06.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91567 2023-11-01T03:41:06.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91632 2023-11-01T03:41:06.221 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91632 2023-11-01T03:41:06.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92249 2023-11-01T03:41:06.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92249 2023-11-01T03:41:06.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.222 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91558 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91558 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91578 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91578 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.223 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91827 2023-11-01T03:41:06.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91827 2023-11-01T03:41:06.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91931 2023-11-01T03:41:06.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91931 2023-11-01T03:41:06.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91859 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91859 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92259 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92259 2023-11-01T03:41:06.225 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.226 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92167 2023-11-01T03:41:06.226 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92167 2023-11-01T03:41:06.226 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.226 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91787 2023-11-01T03:41:06.226 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91787 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92082 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92082 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91551 2023-11-01T03:41:06.227 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91551 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91613 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91613 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92015 2023-11-01T03:41:06.228 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92015 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=91663 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 91663 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92127 2023-11-01T03:41:06.229 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92127 2023-11-01T03:41:06.230 INFO:tasks.workunit.client.0.smithi005.stderr:+ for t in "${!pids[@]}" 2023-11-01T03:41:06.230 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=92143 2023-11-01T03:41:06.230 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 92143 2023-11-01T03:41:06.230 INFO:tasks.workunit.client.0.smithi005.stderr:+ exit 0 2023-11-01T03:41:06.230 INFO:tasks.workunit.client.0.smithi005.stderr:+ cleanup 2023-11-01T03:41:06.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ pkill -P 91546 2023-11-01T03:41:06.232 INFO:tasks.workunit.client.0.smithi005.stderr:+ true 2023-11-01T03:41:06.232 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-01T03:41:06.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-01T03:41:06.305 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2023-11-01T03:41:06.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-01T03:41:06.638 DEBUG:teuthology.parallel:result is None 2023-11-01T03:41:06.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-01T03:41:06.671 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-01T03:41:06.672 DEBUG:teuthology.orchestra.run.smithi005:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-11-01T03:41:06.734 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-11-01T03:41:06.735 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-01T03:41:06.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-01T03:41:06.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:06.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 10 monclient: get_monmap_and_config 2023-11-01T03:41:06.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 10 monclient: build_initial_monmap 2023-11-01T03:41:06.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 10 monclient: monmap: 2023-11-01T03:41:06.881 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:06.882 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:06.882 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:06.880981+0000 2023-11-01T03:41:06.882 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:06.880981+0000 2023-11-01T03:41:06.882 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:06.882 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:06.883 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 1 Processor -- start 2023-11-01T03:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 1 -- start start 2023-11-01T03:41:06.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.879+0000 7fa78c57c640 10 monclient: init 2023-11-01T03:41:06.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:06.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2023-11-01T03:41:06.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7840a8ae0 0x7fa78413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-a con 0x7fa7840a8ae0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 0x7fa78413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-b con 0x7fa7840a8ec0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa7840b0de0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7840a9600 con 0x7fa7840b0de0 2023-11-01T03:41:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7840a9360 con 0x7fa7840a8ae0 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b80b0 con 0x7fa7840a8ec0 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.880+0000 7fa78c57c640 10 monclient(hunting): authenticate will time out at 2743.105432s 2023-11-01T03:41:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 0x7fa78413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78a318640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7840a8ae0 0x7fa78413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78ab19640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa7840b0de0 0x7fa784145000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50884/0 (socket says 172.21.15.5:50884) 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78ab19640 1 -- 172.21.15.5:0/1880161625 learned_addr learned my addr 172.21.15.5:0/1880161625 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): get_auth_request con 0x7fa7840a8ec0 auth_method 0 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:06.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:06.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78a318640 10 monclient(hunting): get_auth_request con 0x7fa7840a8ae0 auth_method 0 2023-11-01T03:41:06.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78a318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:06.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78a318640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:06.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa78a318640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.881+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.882+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.882+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.882+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 10 monclient(hunting): handle_auth_done global_id 17330 payload 274 2023-11-01T03:41:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 1 -- 172.21.15.5:0/1880161625 >> v2:172.21.15.5:3300/0 conn(0x7fa7840a8ae0 msgr2=0x7fa78413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 1 --2- 172.21.15.5:0/1880161625 >> v2:172.21.15.5:3300/0 conn(0x7fa7840a8ae0 0x7fa78413ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 1 -- 172.21.15.5:0/1880161625 >> v1:172.21.15.153:6789/0 conn(0x7fa7840b0de0 legacy=0x7fa784145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 10 monclient: _finish_hunting 0 2023-11-01T03:41:06.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 1 monclient: found mon.noname-b 2023-11-01T03:41:06.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:06.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:06.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.883+0000 7fa789b17640 1 -- 172.21.15.5:0/1880161625 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784145710 con 0x7fa7840a8ec0 2023-11-01T03:41:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.885+0000 7fa789b17640 1 --2- 172.21.15.5:0/1880161625 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 0x7fa78413f170 secure :-1 s=READY pgs=2889 cs=0 l=1 rev1=1 crypto rx=0x7fa7780097a0 tx=0x7fa77802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defecf96d9e5bbe0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 1 -- 172.21.15.5:0/1880161625 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778030610 con 0x7fa7840a8ec0 2023-11-01T03:41:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: dump: 2023-11-01T03:41:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:06.899 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: _finish_auth 0 2023-11-01T03:41:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: _check_auth_tickets 2023-11-01T03:41:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 1 -- 172.21.15.5:0/1880161625 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa778030770 con 0x7fa7840a8ec0 2023-11-01T03:41:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa78c57c640 5 monclient: authenticate success, global_id 17330 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa78c57c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa78c57c640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa78c57c640 4 set_mon_vals no callback set 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 1 -- 172.21.15.5:0/1880161625 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778030b00 con 0x7fa7840a8ec0 2023-11-01T03:41:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.889+0000 7fa789316640 10 monclient: dump: 2023-11-01T03:41:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 10 monclient: shutdown 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 -- 172.21.15.5:0/1880161625 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 msgr2=0x7fa78413f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1880161625 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 0x7fa78413f170 secure :-1 s=READY pgs=2889 cs=0 l=1 rev1=1 crypto rx=0x7fa7780097a0 tx=0x7fa77802b960 comp rx=0 tx=0).stop 2023-11-01T03:41:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 -- 172.21.15.5:0/1880161625 shutdown_connections 2023-11-01T03:41:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1880161625 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840a8ec0 0x7fa78413f170 unknown :-1 s=CLOSED pgs=2889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1880161625 >> v2:172.21.15.5:3300/0 conn(0x7fa7840a8ae0 0x7fa78413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 -- 172.21.15.5:0/1880161625 >> 172.21.15.5:0/1880161625 conn(0x7fa7840b7230 msgr2=0x7fa7840b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 -- 172.21.15.5:0/1880161625 shutdown_connections 2023-11-01T03:41:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.890+0000 7fa78c57c640 1 -- 172.21.15.5:0/1880161625 wait complete. 2023-11-01T03:41:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 10 monclient: build_initial_monmap 2023-11-01T03:41:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 10 monclient: monmap: 2023-11-01T03:41:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 librados: starting msgr at 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 librados: starting objecter 2023-11-01T03:41:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 Processor -- start 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 -- start start 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 librados: setting wanted keys 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 1 librados: calling monclient init 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.891+0000 7fa78c57c640 10 monclient: init 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 0x7fa7841443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-b con 0x7fa7840a8ae0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7840a8ec0 0x7fa7841d9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-a con 0x7fa7840a8ec0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): picked mon.noname-c con 0x7fa7840b0de0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784142490 con 0x7fa7840a8ec0 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784141fb0 con 0x7fa7840a8ae0 2023-11-01T03:41:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa784142120 con 0x7fa7840b0de0 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78c57c640 10 monclient(hunting): authenticate will time out at 2743.117184s 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa789b17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7840a8ec0 0x7fa7841d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78a318640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 0x7fa7841443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46912/0 (socket says 172.21.15.5:46912) 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 1 -- 172.21.15.5:0/1939672322 learned_addr learned my addr 172.21.15.5:0/1939672322 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 10 monclient(hunting): get_auth_request con 0x7fa7840b0de0 auth_method 0 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78ab19640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78a318640 10 monclient(hunting): get_auth_request con 0x7fa7840a8ae0 auth_method 0 2023-11-01T03:41:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78a318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78a318640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.892+0000 7fa78a318640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): get_auth_request con 0x7fa7840a8ec0 auth_method 0 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78ab19640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78ab19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78ab19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa78a318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.893+0000 7fa789b17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 10 monclient(hunting): handle_auth_done global_id 17333 payload 824 2023-11-01T03:41:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 -- 172.21.15.5:0/1939672322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 msgr2=0x7fa7841443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 0x7fa7841443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 -- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7840a8ec0 msgr2=0x7fa7841d9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7840a8ec0 0x7fa7841d9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 10 monclient: _finish_hunting 0 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 monclient: found mon.noname-c 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78ab19640 1 -- 172.21.15.5:0/1939672322 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778009400 con 0x7fa7840b0de0 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.896+0000 7fa78a318640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 0x7fa7841443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.898+0000 7fa78ab19640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 secure :-1 s=READY pgs=2890 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c3f0 tx=0x7fa77c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.898+0000 7fa782ffd640 10 client.?.objecter ms_handle_connect 0x7fa7840b0de0 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.898+0000 7fa782ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c005ce0 con 0x7fa7840b0de0 2023-11-01T03:41:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: dump: 2023-11-01T03:41:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:06.923 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: _finish_auth 0 2023-11-01T03:41:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c005e40 con 0x7fa7840b0de0 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0072f0 con 0x7fa7840b0de0 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa782ffd640 10 monclient: dump: 2023-11-01T03:41:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 5 monclient: authenticate success, global_id 17333 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 10 monclient: _renew_subs 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7841da300 con 0x7fa7840b0de0 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa788b15640 4 set_mon_vals no callback set 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 10 client.17333.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 10 monclient: _renew_subs 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa784137930 con 0x7fa7840b0de0 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.902+0000 7fa78c57c640 1 librados: init done 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.903+0000 7fa78c57c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.903+0000 7fa78c57c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.903+0000 7fa78c57c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.903+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa784142640 con 0x7fa7840b0de0 2023-11-01T03:41:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.922+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa77c007450 con 0x7fa7840b0de0 2023-11-01T03:41:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.923+0000 7fa782ffd640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 0x7fa77006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.923+0000 7fa78a318640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 0x7fa77006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.923+0000 7fa78a318640 10 monclient: get_auth_request con 0x7fa77006c800 auth_method 0 2023-11-01T03:41:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.923+0000 7fa78a318640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 0x7fa77006ecc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa774009fd0 tx=0x7fa77400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:06.923+0000 7fa782ffd640 10 client.17333.objecter ms_handle_connect 0x7fa77006c800 2023-11-01T03:41:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(902..902 src has 549..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fa77c057e10 con 0x7fa7840b0de0 2023-11-01T03:41:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 10 client.17333.objecter ms_dispatch 0x7fa784000b90 osd_map(902..902 src has 549..902) v4 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 3 client.17333.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 3 client.17333.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 20 client.17333.objecter dump_active .. 0 homeless 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa77c054150 con 0x7fa7840b0de0 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.196+0000 7fa782ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:07.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.380+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa78414c1c0 con 0x7fa77006c800 2023-11-01T03:41:07.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.385+0000 7fa782ffd640 1 -- 172.21.15.5:0/1939672322 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151641 (secure 0 0 0) 0x7fa77400f040 con 0x7fa77006c800 2023-11-01T03:41:07.388 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:07.389 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 10 librados: watch_flush enter 2023-11-01T03:41:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 10 librados: watch_flush exit 2023-11-01T03:41:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 20 client.17333.objecter shutdown clearing up homeless session... 2023-11-01T03:41:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 10 client.17333.objecter successfully canceled tick 2023-11-01T03:41:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 msgr2=0x7fa77006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 0x7fa77006ecc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa774009fd0 tx=0x7fa77400b040 comp rx=0 tx=0).stop 2023-11-01T03:41:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 10 monclient: shutdown 2023-11-01T03:41:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 msgr2=0x7fa7841d9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 secure :-1 s=READY pgs=2890 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c3f0 tx=0x7fa77c00c8b0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 shutdown_connections 2023-11-01T03:41:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fa77006c800 0x7fa77006ecc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fa7840b0de0 0x7fa7841d9d60 unknown :-1 s=CLOSED pgs=2890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7840a8ec0 0x7fa7841d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 --2- 172.21.15.5:0/1939672322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7840a8ae0 0x7fa7841443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 >> 172.21.15.5:0/1939672322 conn(0x7fa7840b7230 msgr2=0x7fa784135bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 shutdown_connections 2023-11-01T03:41:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 -- 172.21.15.5:0/1939672322 wait complete. 2023-11-01T03:41:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.388+0000 7fa78c57c640 1 librados: shutdown 2023-11-01T03:41:07.400 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1570,"stamp":"2023-11-01T03:41:06.195445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":536816,"kb_used_data":43060,"kb_used_omap":12,"kb_used_meta":493619,"kb_avail":754437904,"statfs":{"total":773094113280,"available":772544413696,"internally_reserved":0,"allocated":44093440,"data_stored":23903164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":505466425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":373,"apply_latency_ms":373,"commit_latency_ns":373000000,"apply_latency_ns":373000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-27,"num_read_kb":-9,"num_write":-68,"num_write_kb":-3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.687374"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.734551+0000","last_change":"2023-11-01T03:20:28.999446+0000","last_active":"2023-11-01T03:41:00.734551+0000","last_peered":"2023-11-01T03:41:00.734551+0000","last_clean":"2023-11-01T03:41:00.734551+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:00.734551+0000","last_undegraded":"2023-11-01T03:41:00.734551+0000","last_fullsized":"2023-11-01T03:41:00.734551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:52:15.750885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.526486+0000","last_change":"2023-11-01T03:20:21.292351+0000","last_active":"2023-11-01T03:41:00.526486+0000","last_peered":"2023-11-01T03:41:00.526486+0000","last_clean":"2023-11-01T03:41:00.526486+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:00.526486+0000","last_undegraded":"2023-11-01T03:41:00.526486+0000","last_fullsized":"2023-11-01T03:41:00.526486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:45.398675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":849,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.708361+0000","last_change":"2023-11-01T03:20:24.849514+0000","last_active":"2023-11-01T03:41:01.708361+0000","last_peered":"2023-11-01T03:41:01.708361+0000","last_clean":"2023-11-01T03:41:01.708361+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:01.708361+0000","last_undegraded":"2023-11-01T03:41:01.708361+0000","last_fullsized":"2023-11-01T03:41:01.708361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:42.030216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.778198+0000","last_change":"2023-11-01T03:20:28.961484+0000","last_active":"2023-11-01T03:41:01.778198+0000","last_peered":"2023-11-01T03:41:01.778198+0000","last_clean":"2023-11-01T03:41:01.778198+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:01.778198+0000","last_undegraded":"2023-11-01T03:41:01.778198+0000","last_fullsized":"2023-11-01T03:41:01.778198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:57:14.344671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.692508+0000","last_change":"2023-11-01T03:20:14.753917+0000","last_active":"2023-11-01T03:41:00.692508+0000","last_peered":"2023-11-01T03:41:00.692508+0000","last_clean":"2023-11-01T03:41:00.692508+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:00.692508+0000","last_undegraded":"2023-11-01T03:41:00.692508+0000","last_fullsized":"2023-11-01T03:41:00.692508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:16:48.817140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":848,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.493997+0000","last_change":"2023-11-01T03:20:19.035194+0000","last_active":"2023-11-01T03:41:00.493997+0000","last_peered":"2023-11-01T03:41:00.493997+0000","last_clean":"2023-11-01T03:41:00.493997+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:00.493997+0000","last_undegraded":"2023-11-01T03:41:00.493997+0000","last_fullsized":"2023-11-01T03:41:00.493997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:36:18.123385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.675805+0000","last_change":"2023-11-01T03:21:04.928879+0000","last_active":"2023-11-01T03:41:01.675805+0000","last_peered":"2023-11-01T03:41:01.675805+0000","last_clean":"2023-11-01T03:41:01.675805+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:01.675805+0000","last_undegraded":"2023-11-01T03:41:01.675805+0000","last_fullsized":"2023-11-01T03:41:01.675805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:59:54.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":848,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.501152+0000","last_change":"2023-11-01T03:20:17.044459+0000","last_active":"2023-11-01T03:41:00.501152+0000","last_peered":"2023-11-01T03:41:00.501152+0000","last_clean":"2023-11-01T03:41:00.501152+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:00.501152+0000","last_undegraded":"2023-11-01T03:41:00.501152+0000","last_fullsized":"2023-11-01T03:41:00.501152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:12:42.352566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.947434+0000","last_change":"2023-11-01T03:20:21.310132+0000","last_active":"2023-11-01T03:41:02.947434+0000","last_peered":"2023-11-01T03:41:02.947434+0000","last_clean":"2023-11-01T03:41:02.947434+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:02.947434+0000","last_undegraded":"2023-11-01T03:41:02.947434+0000","last_fullsized":"2023-11-01T03:41:02.947434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:50:11.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.528113+0000","last_change":"2023-11-01T03:20:21.284659+0000","last_active":"2023-11-01T03:41:00.528113+0000","last_peered":"2023-11-01T03:41:00.528113+0000","last_clean":"2023-11-01T03:41:00.528113+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:00.528113+0000","last_undegraded":"2023-11-01T03:41:00.528113+0000","last_fullsized":"2023-11-01T03:41:00.528113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:27:21.187272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.986156+0000","last_change":"2023-11-01T03:20:24.027089+0000","last_active":"2023-11-01T03:41:02.986156+0000","last_peered":"2023-11-01T03:41:02.986156+0000","last_clean":"2023-11-01T03:41:02.986156+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:02.986156+0000","last_undegraded":"2023-11-01T03:41:02.986156+0000","last_fullsized":"2023-11-01T03:41:02.986156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:29:01.442024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.999907+0000","last_change":"2023-11-01T03:20:25.928340+0000","last_active":"2023-11-01T03:41:02.999907+0000","last_peered":"2023-11-01T03:41:02.999907+0000","last_clean":"2023-11-01T03:41:02.999907+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:02.999907+0000","last_undegraded":"2023-11-01T03:41:02.999907+0000","last_fullsized":"2023-11-01T03:41:02.999907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:44:04.520733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.570862+0000","last_change":"2023-11-01T03:20:21.132613+0000","last_active":"2023-11-01T03:41:01.570862+0000","last_peered":"2023-11-01T03:41:01.570862+0000","last_clean":"2023-11-01T03:41:01.570862+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:01.570862+0000","last_undegraded":"2023-11-01T03:41:01.570862+0000","last_fullsized":"2023-11-01T03:41:01.570862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:14:39.509557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.746532+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:41:00.746532+0000","last_peered":"2023-11-01T03:41:00.746532+0000","last_clean":"2023-11-01T03:41:00.746532+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:00.746532+0000","last_undegraded":"2023-11-01T03:41:00.746532+0000","last_fullsized":"2023-11-01T03:41:00.746532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":854,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.736259+0000","last_change":"2023-11-01T03:20:20.628315+0000","last_active":"2023-11-01T03:41:00.736259+0000","last_peered":"2023-11-01T03:41:00.736259+0000","last_clean":"2023-11-01T03:41:00.736259+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:00.736259+0000","last_undegraded":"2023-11-01T03:41:00.736259+0000","last_fullsized":"2023-11-01T03:41:00.736259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:13:44.355143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":854,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.548731+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:41:00.548731+0000","last_peered":"2023-11-01T03:41:00.548731+0000","last_clean":"2023-11-01T03:41:00.548731+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:00.548731+0000","last_undegraded":"2023-11-01T03:41:00.548731+0000","last_fullsized":"2023-11-01T03:41:00.548731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:05:15.577920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.715332+0000","last_change":"2023-11-01T03:20:22.257051+0000","last_active":"2023-11-01T03:41:01.715332+0000","last_peered":"2023-11-01T03:41:01.715332+0000","last_clean":"2023-11-01T03:41:01.715332+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:01.715332+0000","last_undegraded":"2023-11-01T03:41:01.715332+0000","last_fullsized":"2023-11-01T03:41:01.715332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:59:19.002962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.738593+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:41:00.738593+0000","last_peered":"2023-11-01T03:41:00.738593+0000","last_clean":"2023-11-01T03:41:00.738593+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:00.738593+0000","last_undegraded":"2023-11-01T03:41:00.738593+0000","last_fullsized":"2023-11-01T03:41:00.738593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.740155+0000","last_change":"2023-11-01T03:20:24.831827+0000","last_active":"2023-11-01T03:41:01.740155+0000","last_peered":"2023-11-01T03:41:01.740155+0000","last_clean":"2023-11-01T03:41:01.740155+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:01.740155+0000","last_undegraded":"2023-11-01T03:41:01.740155+0000","last_fullsized":"2023-11-01T03:41:01.740155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:48:19.626083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":867,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.529764+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:41:00.529764+0000","last_peered":"2023-11-01T03:41:00.529764+0000","last_clean":"2023-11-01T03:41:00.529764+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:00.529764+0000","last_undegraded":"2023-11-01T03:41:00.529764+0000","last_fullsized":"2023-11-01T03:41:00.529764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.509242+0000","last_change":"2023-11-01T03:20:38.569214+0000","last_active":"2023-11-01T03:41:00.509242+0000","last_peered":"2023-11-01T03:41:00.509242+0000","last_clean":"2023-11-01T03:41:00.509242+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:00.509242+0000","last_undegraded":"2023-11-01T03:41:00.509242+0000","last_fullsized":"2023-11-01T03:41:00.509242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:01:54.979113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.712229+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:41:00.712229+0000","last_peered":"2023-11-01T03:41:00.712229+0000","last_clean":"2023-11-01T03:41:00.712229+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:00.712229+0000","last_undegraded":"2023-11-01T03:41:00.712229+0000","last_fullsized":"2023-11-01T03:41:00.712229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":849,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.499455+0000","last_change":"2023-11-01T03:20:28.854647+0000","last_active":"2023-11-01T03:41:00.499455+0000","last_peered":"2023-11-01T03:41:00.499455+0000","last_clean":"2023-11-01T03:41:00.499455+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:00.499455+0000","last_undegraded":"2023-11-01T03:41:00.499455+0000","last_fullsized":"2023-11-01T03:41:00.499455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:21:38.217969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":856,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.578031+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:41:01.578031+0000","last_peered":"2023-11-01T03:41:01.578031+0000","last_clean":"2023-11-01T03:41:01.578031+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:01.578031+0000","last_undegraded":"2023-11-01T03:41:01.578031+0000","last_fullsized":"2023-11-01T03:41:01.578031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.518598+0000","last_change":"2023-11-01T03:20:27.836705+0000","last_active":"2023-11-01T03:41:00.518598+0000","last_peered":"2023-11-01T03:41:00.518598+0000","last_clean":"2023-11-01T03:41:00.518598+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:00.518598+0000","last_undegraded":"2023-11-01T03:41:00.518598+0000","last_fullsized":"2023-11-01T03:41:00.518598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:24:51.036742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.668334+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:41:00.668334+0000","last_peered":"2023-11-01T03:41:00.668334+0000","last_clean":"2023-11-01T03:41:00.668334+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:00.668334+0000","last_undegraded":"2023-11-01T03:41:00.668334+0000","last_fullsized":"2023-11-01T03:41:00.668334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.501088+0000","last_change":"2023-11-01T03:20:25.561602+0000","last_active":"2023-11-01T03:41:00.501088+0000","last_peered":"2023-11-01T03:41:00.501088+0000","last_clean":"2023-11-01T03:41:00.501088+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:00.501088+0000","last_undegraded":"2023-11-01T03:41:00.501088+0000","last_fullsized":"2023-11-01T03:41:00.501088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:09:15.818152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.724979+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:41:00.724979+0000","last_peered":"2023-11-01T03:41:00.724979+0000","last_clean":"2023-11-01T03:41:00.724979+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:00.724979+0000","last_undegraded":"2023-11-01T03:41:00.724979+0000","last_fullsized":"2023-11-01T03:41:00.724979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":960,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.497171+0000","last_change":"2023-11-01T03:19:01.879653+0000","last_active":"2023-11-01T03:41:00.497171+0000","last_peered":"2023-11-01T03:41:00.497171+0000","last_clean":"2023-11-01T03:41:00.497171+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:00.497171+0000","last_undegraded":"2023-11-01T03:41:00.497171+0000","last_fullsized":"2023-11-01T03:41:00.497171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_clean_scrub_stamp":"2023-11-01T03:18:57.938958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:10:19.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":868,"reported_epoch":900,"state":"active+clean","last_fresh":"2023-11-01T03:41:04.319158+0000","last_change":"2023-11-01T03:20:23.770784+0000","last_active":"2023-11-01T03:41:04.319158+0000","last_peered":"2023-11-01T03:41:04.319158+0000","last_clean":"2023-11-01T03:41:04.319158+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:04.319158+0000","last_undegraded":"2023-11-01T03:41:04.319158+0000","last_fullsized":"2023-11-01T03:41:04.319158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:52:35.620928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.711889+0000","last_change":"2023-11-01T03:20:16.655844+0000","last_active":"2023-11-01T03:41:01.711889+0000","last_peered":"2023-11-01T03:41:01.711889+0000","last_clean":"2023-11-01T03:41:01.711889+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:01.711889+0000","last_undegraded":"2023-11-01T03:41:01.711889+0000","last_fullsized":"2023-11-01T03:41:01.711889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:09:46.488826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":863,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.504037+0000","last_change":"2023-11-01T03:20:27.628859+0000","last_active":"2023-11-01T03:41:00.504037+0000","last_peered":"2023-11-01T03:41:00.504037+0000","last_clean":"2023-11-01T03:41:00.504037+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:00.504037+0000","last_undegraded":"2023-11-01T03:41:00.504037+0000","last_fullsized":"2023-11-01T03:41:00.504037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:50:18.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"39'7","reported_seq":865,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:03.328908+0000","last_change":"2023-11-01T03:20:16.772503+0000","last_active":"2023-11-01T03:41:03.328908+0000","last_peered":"2023-11-01T03:41:03.328908+0000","last_clean":"2023-11-01T03:41:03.328908+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:03.328908+0000","last_undegraded":"2023-11-01T03:41:03.328908+0000","last_fullsized":"2023-11-01T03:41:03.328908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:41:51.271420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.717542+0000","last_change":"2023-11-01T03:20:20.690944+0000","last_active":"2023-11-01T03:41:01.717542+0000","last_peered":"2023-11-01T03:41:01.717542+0000","last_clean":"2023-11-01T03:41:01.717542+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:01.717542+0000","last_undegraded":"2023-11-01T03:41:01.717542+0000","last_fullsized":"2023-11-01T03:41:01.717542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:55:05.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.741885+0000","last_change":"2023-11-01T03:20:31.376540+0000","last_active":"2023-11-01T03:41:01.741885+0000","last_peered":"2023-11-01T03:41:01.741885+0000","last_clean":"2023-11-01T03:41:01.741885+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:01.741885+0000","last_undegraded":"2023-11-01T03:41:01.741885+0000","last_fullsized":"2023-11-01T03:41:01.741885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:48:22.668122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.572774+0000","last_change":"2023-11-01T03:20:15.800818+0000","last_active":"2023-11-01T03:41:01.572774+0000","last_peered":"2023-11-01T03:41:01.572774+0000","last_clean":"2023-11-01T03:41:01.572774+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:01.572774+0000","last_undegraded":"2023-11-01T03:41:01.572774+0000","last_fullsized":"2023-11-01T03:41:01.572774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:20:00.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.533702+0000","last_change":"2023-11-01T03:20:38.737137+0000","last_active":"2023-11-01T03:41:00.533702+0000","last_peered":"2023-11-01T03:41:00.533702+0000","last_clean":"2023-11-01T03:41:00.533702+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:00.533702+0000","last_undegraded":"2023-11-01T03:41:00.533702+0000","last_fullsized":"2023-11-01T03:41:00.533702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:57:06.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.510928+0000","last_change":"2023-11-01T03:20:21.863000+0000","last_active":"2023-11-01T03:41:00.510928+0000","last_peered":"2023-11-01T03:41:00.510928+0000","last_clean":"2023-11-01T03:41:00.510928+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:00.510928+0000","last_undegraded":"2023-11-01T03:41:00.510928+0000","last_fullsized":"2023-11-01T03:41:00.510928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:08:06.676287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":849,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.541222+0000","last_change":"2023-11-01T03:20:21.943627+0000","last_active":"2023-11-01T03:41:00.541222+0000","last_peered":"2023-11-01T03:41:00.541222+0000","last_clean":"2023-11-01T03:41:00.541222+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:00.541222+0000","last_undegraded":"2023-11-01T03:41:00.541222+0000","last_fullsized":"2023-11-01T03:41:00.541222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:31:18.289912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.661847+0000","last_change":"2023-11-01T03:20:31.359278+0000","last_active":"2023-11-01T03:41:01.661847+0000","last_peered":"2023-11-01T03:41:01.661847+0000","last_clean":"2023-11-01T03:41:01.661847+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:01.661847+0000","last_undegraded":"2023-11-01T03:41:01.661847+0000","last_fullsized":"2023-11-01T03:41:01.661847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:03:02.004192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.886975+0000","last_change":"2023-11-01T03:20:20.196742+0000","last_active":"2023-11-01T03:41:02.886975+0000","last_peered":"2023-11-01T03:41:02.886975+0000","last_clean":"2023-11-01T03:41:02.886975+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:02.886975+0000","last_undegraded":"2023-11-01T03:41:02.886975+0000","last_fullsized":"2023-11-01T03:41:02.886975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:20:43.175812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58612,"kb_used_data":5224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313228,"statfs":{"total":96636764160,"available":96576745472,"internally_reserved":0,"allocated":5349376,"data_stored":2829167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":9.9390000000000001},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":11.432}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":10.82},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":24.141999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":31.701000000000001},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":22.506}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":7.7329999999999997},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":20.841999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":23.494},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":18.329000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":26.986000000000001},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":30.585999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":36.545000000000002},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":25.515999999999998}]}]},{"osd":1,"up_from":16,"seq":68719477001,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63204,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308636,"statfs":{"total":96636764160,"available":96572043264,"internally_reserved":0,"allocated":5791744,"data_stored":3267967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":26.581,"5min":15.032,"15min":17.754000000000001},"min":{"1min":6.7830000000000004,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":202.77600000000001,"5min":202.77600000000001,"15min":233.18799999999999},"last":10.470000000000001},{"interface":"front","average":{"1min":25.585000000000001,"5min":17.437000000000001,"15min":20.001000000000001},"min":{"1min":8.0950000000000006,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":211.577,"5min":211.577,"15min":227.72900000000001},"last":9.7859999999999996}]},{"osd":2,"last update":"Wed Nov 1 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":15.635,"5min":19.303000000000001,"15min":23.484999999999999},"min":{"1min":7.8239999999999998,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":62.979999999999997,"5min":157.964,"15min":226.35300000000001},"last":14.135},{"interface":"front","average":{"1min":16.472000000000001,"5min":21.312000000000001,"15min":22.969000000000001},"min":{"1min":8.7490000000000006,"5min":7.649,"15min":6.7699999999999996},"max":{"1min":44.670999999999999,"5min":230.01499999999999,"15min":230.01499999999999},"last":7.7000000000000002}]},{"osd":3,"last update":"Wed Nov 1 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":15.041,"5min":18.98,"15min":31.536000000000001},"min":{"1min":8.5410000000000004,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":22.731999999999999,"5min":107.58799999999999,"15min":549.26300000000003},"last":11.209},{"interface":"front","average":{"1min":10.016,"5min":14.983000000000001,"15min":30.420999999999999},"min":{"1min":7.4240000000000004,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":18.459,"5min":167.44900000000001,"15min":431.52999999999997},"last":8.5890000000000004}]},{"osd":4,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":25.346,"5min":19.154,"15min":21.763999999999999},"min":{"1min":6.8310000000000004,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":92.372,"5min":92.372,"15min":228.119},"last":16.838000000000001},{"interface":"front","average":{"1min":21.606000000000002,"5min":17.113,"15min":22.614999999999998},"min":{"1min":6.8810000000000002,"5min":6.7969999999999997,"15min":6.7969999999999997},"max":{"1min":82.914000000000001,"5min":82.914000000000001,"15min":265.774},"last":14.795}]},{"osd":5,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":20.431999999999999,"5min":21.949999999999999,"15min":26.109999999999999},"min":{"1min":7.234,"5min":7.234,"15min":7.234},"max":{"1min":47.537999999999997,"5min":104.411,"15min":277.53100000000001},"last":12.576000000000001},{"interface":"front","average":{"1min":18.678999999999998,"5min":21.218,"15min":25.378},"min":{"1min":7.9809999999999999,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":86.488,"5min":107.372,"15min":270.26400000000001},"last":15.449}]},{"osd":6,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.664999999999999,"5min":22.835999999999999,"15min":26.817},"min":{"1min":10.542999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":55.893000000000001,"5min":111.179,"15min":240.887},"last":11.837999999999999},{"interface":"front","average":{"1min":22.527999999999999,"5min":26.219999999999999,"15min":29.495999999999999},"min":{"1min":14.475,"5min":13.331,"15min":10.785},"max":{"1min":59.003999999999998,"5min":144.75399999999999,"15min":271.04899999999998},"last":20.152999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.878,"5min":17.433,"15min":26.861000000000001},"min":{"1min":9.0549999999999997,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":88.796000000000006,"5min":88.796000000000006,"15min":348.608},"last":16.190000000000001},{"interface":"front","average":{"1min":24.318999999999999,"5min":24.468,"15min":31.408000000000001},"min":{"1min":15.694000000000001,"5min":12.734999999999999,"15min":11.98},"max":{"1min":89.978999999999999,"5min":104.134,"15min":345.22899999999998},"last":13.481999999999999}]}]},{"osd":3,"up_from":16,"seq":68719477001,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76716,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295124,"statfs":{"total":96636764160,"available":96558206976,"internally_reserved":0,"allocated":5398528,"data_stored":2878319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":11.449},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":10.776999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":7.9649999999999999},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":8.4559999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":13.223000000000001},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":8.8819999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":12.593999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":13.981}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":18.126999999999999},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":16.663}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":14.612},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":15.348000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":15.976000000000001},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":17.323}]}]},{"osd":0,"up_from":16,"seq":68719477002,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62852,"kb_used_data":5300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308988,"statfs":{"total":96636764160,"available":96572403712,"internally_reserved":0,"allocated":5427200,"data_stored":2898189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":15.183,"5min":13.965999999999999,"15min":20.741},"min":{"1min":8.4350000000000005,"5min":6.2430000000000003,"15min":5.0919999999999996},"max":{"1min":29.344000000000001,"5min":63.280000000000001,"15min":193.87200000000001},"last":8.9359999999999999},{"interface":"front","average":{"1min":13.127000000000001,"5min":13.782,"15min":19.478999999999999},"min":{"1min":6.4610000000000003,"5min":6.0229999999999997,"15min":6.0179999999999998},"max":{"1min":41.377000000000002,"5min":61.674999999999997,"15min":208.66800000000001},"last":9.7989999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.792000000000002,"5min":17.826000000000001,"15min":24.395},"min":{"1min":9.9939999999999998,"5min":8.1379999999999999,"15min":6.657},"max":{"1min":31.626000000000001,"5min":93.488,"15min":238.64400000000001},"last":12.885},{"interface":"front","average":{"1min":16.863,"5min":16.988,"15min":21.623000000000001},"min":{"1min":7.1680000000000001,"5min":6.8760000000000003,"15min":6.2300000000000004},"max":{"1min":50.618000000000002,"5min":102.666,"15min":272.35500000000002},"last":12.161}]},{"osd":3,"last update":"Wed Nov 1 03:40:51 2023","interfaces":[{"interface":"back","average":{"1min":16.027999999999999,"5min":15.141999999999999,"15min":25.698},"min":{"1min":7.6429999999999998,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":67.299999999999997,"5min":67.299999999999997,"15min":285.99099999999999},"last":10.35},{"interface":"front","average":{"1min":22.164000000000001,"5min":21.707000000000001,"15min":27.375},"min":{"1min":10.720000000000001,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":66.314999999999998,"5min":216.52000000000001,"15min":334.51100000000002},"last":13.898999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.289999999999999,"5min":20.956,"15min":24.43},"min":{"1min":11.702,"5min":7.5789999999999997,"15min":7.5789999999999997},"max":{"1min":38.886000000000003,"5min":206.935,"15min":206.935},"last":17.504999999999999},{"interface":"front","average":{"1min":18.594999999999999,"5min":18.873999999999999,"15min":25.129999999999999},"min":{"1min":11.151,"5min":6.867,"15min":6.867},"max":{"1min":51.771999999999998,"5min":143.786,"15min":259.03399999999999},"last":8.2409999999999997}]},{"osd":5,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.010999999999999,"5min":21.155000000000001,"15min":22.881},"min":{"1min":6.7779999999999996,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.651000000000003,"5min":178.88300000000001,"15min":225.07300000000001},"last":11.311999999999999},{"interface":"front","average":{"1min":22.504000000000001,"5min":25.228999999999999,"15min":26.687999999999999},"min":{"1min":13.220000000000001,"5min":11.926,"15min":8.423},"max":{"1min":50.25,"5min":178.24199999999999,"15min":198.66900000000001},"last":14.567}]},{"osd":6,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":20.844000000000001,"15min":28.954999999999998},"min":{"1min":9.218,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":53.276000000000003,"5min":177.26900000000001,"15min":450.18599999999998},"last":16.591999999999999},{"interface":"front","average":{"1min":24.831,"5min":24.460000000000001,"15min":31.073},"min":{"1min":15.340999999999999,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":51.051000000000002,"5min":91.165999999999997,"15min":282.93000000000001},"last":19.184999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":22.015000000000001,"5min":23.861999999999998,"15min":27.366},"min":{"1min":9.5079999999999991,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":52.453000000000003,"5min":144.767,"15min":230.99600000000001},"last":15.206},{"interface":"front","average":{"1min":24.102,"5min":25.707999999999998,"15min":30.646000000000001},"min":{"1min":10.026999999999999,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":45.552,"5min":148.28200000000001,"15min":226.959},"last":18.347999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509707,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77100,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294740,"statfs":{"total":96636764160,"available":96557813760,"internally_reserved":0,"allocated":5791744,"data_stored":3267967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":10.679,"5min":14.500999999999999,"15min":18.439},"min":{"1min":4.9640000000000004,"5min":4.444,"15min":4.444},"max":{"1min":20.597999999999999,"5min":70.945999999999998,"15min":231.386},"last":91.474999999999994},{"interface":"front","average":{"1min":10.138,"5min":16.434999999999999,"15min":21.382999999999999},"min":{"1min":5.0300000000000002,"5min":4.5090000000000003,"15min":4.5090000000000003},"max":{"1min":18.754999999999999,"5min":111.236,"15min":229.50299999999999},"last":49.658000000000001}]},{"osd":1,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.744999999999999,"5min":20.986999999999998,"15min":23.802},"min":{"1min":6.3540000000000001,"5min":6.0179999999999998,"15min":5.3780000000000001},"max":{"1min":58.527999999999999,"5min":302.94099999999997,"15min":328.08199999999999},"last":120.39},{"interface":"front","average":{"1min":18.532,"5min":27.169,"15min":31.489000000000001},"min":{"1min":8.2050000000000001,"5min":7.6340000000000003,"15min":7.6340000000000003},"max":{"1min":60.542999999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":124.95399999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":15.901,"5min":22.568000000000001,"15min":23.664999999999999},"min":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":34.584000000000003,"5min":195.53700000000001,"15min":195.53700000000001},"last":45.817999999999998},{"interface":"front","average":{"1min":13.531000000000001,"5min":22.632000000000001,"15min":22.719000000000001},"min":{"1min":6.4530000000000003,"5min":6.4109999999999996,"15min":6.0259999999999998},"max":{"1min":20.637,"5min":252.57900000000001,"15min":252.57900000000001},"last":44.540999999999997}]},{"osd":3,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":15.587,"5min":25.533000000000001,"15min":30.013000000000002},"min":{"1min":9.452,"5min":6.383,"15min":6.383},"max":{"1min":22.768000000000001,"5min":226.05600000000001,"15min":726.51099999999997},"last":53.186},{"interface":"front","average":{"1min":15.470000000000001,"5min":26.940000000000001,"15min":31.023},"min":{"1min":10.199,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":25.969999999999999,"5min":186.75999999999999,"15min":784.01700000000005},"last":37.101999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.624000000000001,"5min":24.079999999999998,"15min":27.091999999999999},"min":{"1min":7.2830000000000004,"5min":7.2530000000000001,"15min":6.8979999999999997},"max":{"1min":28.57,"5min":158.505,"15min":327.47699999999998},"last":121.00700000000001},{"interface":"front","average":{"1min":17.361999999999998,"5min":27.986999999999998,"15min":30.132000000000001},"min":{"1min":9.1989999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":29.838000000000001,"5min":205.315,"15min":315.95100000000002},"last":38.863}]},{"osd":6,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":16.306999999999999,"5min":27.713999999999999,"15min":28.725000000000001},"min":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":29.844999999999999,"5min":171.857,"15min":249.559},"last":94.876000000000005},{"interface":"front","average":{"1min":14.456,"5min":27.353999999999999,"15min":31.786999999999999},"min":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":24.298999999999999,"5min":182.077,"15min":383.42099999999999},"last":133.702}]},{"osd":7,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":17.582000000000001,"5min":25.562000000000001,"15min":28.114999999999998},"min":{"1min":11.412000000000001,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":32.265999999999998,"5min":170.60599999999999,"15min":215.22399999999999},"last":42.237000000000002},{"interface":"front","average":{"1min":17.917000000000002,"5min":24.146000000000001,"15min":27.420000000000002},"min":{"1min":11.912000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":30.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":48.853000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542411,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5398528,"data_stored":2874228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":22.065000000000001,"5min":24.597999999999999,"15min":21.370999999999999},"min":{"1min":5.3769999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":132.393,"5min":205.869,"15min":205.869},"last":11.029},{"interface":"front","average":{"1min":23.149999999999999,"5min":28.571999999999999,"15min":25.462},"min":{"1min":10.762,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":146.113,"5min":248.73099999999999,"15min":248.73099999999999},"last":16.672999999999998}]},{"osd":1,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":12.084,"5min":21.053999999999998,"15min":23.530000000000001},"min":{"1min":6.6020000000000003,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":61.753,"5min":272.86900000000003,"15min":272.86900000000003},"last":7.4829999999999997},{"interface":"front","average":{"1min":28.754999999999999,"5min":28.062000000000001,"15min":28.823},"min":{"1min":9.8300000000000001,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":267.911,"5min":267.911,"15min":352.642},"last":14.414}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":17.931000000000001,"5min":24.111999999999998,"15min":24.303999999999998},"min":{"1min":8.8209999999999997,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":62.329000000000001,"5min":153.25399999999999,"15min":167.721},"last":15.112},{"interface":"front","average":{"1min":17.760999999999999,"5min":20.530999999999999,"15min":22.216000000000001},"min":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":71.908000000000001,"5min":156.71199999999999,"15min":317.15300000000002},"last":9.8070000000000004}]},{"osd":3,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":19.149999999999999,"5min":28.553999999999998,"15min":28.556000000000001},"min":{"1min":9.6020000000000003,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":66.546000000000006,"5min":207.48699999999999,"15min":864.23099999999999},"last":12.93},{"interface":"front","average":{"1min":25.015999999999998,"5min":25.204000000000001,"15min":21.548999999999999},"min":{"1min":6.2699999999999996,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":136.334,"5min":210.626,"15min":263.649},"last":9.0640000000000001}]},{"osd":4,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.088000000000001,"5min":27.611000000000001,"15min":24.763000000000002},"min":{"1min":11.535,"5min":7.6989999999999998,"15min":7.2000000000000002},"max":{"1min":89.551000000000002,"5min":159.137,"15min":168.39099999999999},"last":18.556000000000001},{"interface":"front","average":{"1min":16.887,"5min":23.902999999999999,"15min":21.550000000000001},"min":{"1min":9.5350000000000001,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":81.560000000000002,"5min":160.304,"15min":160.304},"last":12.242000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.786999999999999,"5min":27.809999999999999,"15min":23.050000000000001},"min":{"1min":11.93,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":80.522999999999996,"5min":155.24299999999999,"15min":270.94600000000003},"last":17.510000000000002},{"interface":"front","average":{"1min":18.129000000000001,"5min":25.039000000000001,"15min":26.381},"min":{"1min":10.413,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":65.290999999999997,"5min":153.74199999999999,"15min":272.613},"last":13.592000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":14.641999999999999,"5min":18.841000000000001,"15min":20.309000000000001},"min":{"1min":6.798,"5min":6.3719999999999999,"15min":5.9080000000000004},"max":{"1min":99.433000000000007,"5min":153.58699999999999,"15min":204.26400000000001},"last":28.861999999999998},{"interface":"front","average":{"1min":22.571999999999999,"5min":28.119,"15min":29.311},"min":{"1min":11.381,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":94.052999999999997,"5min":176.62899999999999,"15min":187.38900000000001},"last":19.486000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575116,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80956,"kb_used_data":5360,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290884,"statfs":{"total":96636764160,"available":96553865216,"internally_reserved":0,"allocated":5488640,"data_stored":2959629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":14.619,"5min":18.068999999999999,"15min":17.006},"min":{"1min":4.7889999999999997,"5min":4.4829999999999997,"15min":4.431},"max":{"1min":74.355000000000004,"5min":182.16200000000001,"15min":215.01400000000001},"last":6.7119999999999997},{"interface":"front","average":{"1min":15.571999999999999,"5min":18.236999999999998,"15min":17.800999999999998},"min":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":70.613,"5min":165.08500000000001,"15min":208.00800000000001},"last":11.363}]},{"osd":1,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":18.352,"5min":26.658000000000001,"15min":23.210000000000001},"min":{"1min":5.6749999999999998,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":120.19799999999999,"5min":508.113,"15min":508.113},"last":10.365},{"interface":"front","average":{"1min":14.755000000000001,"5min":21.356999999999999,"15min":19.134},"min":{"1min":6.5369999999999999,"5min":6.4210000000000003,"15min":5.1879999999999997},"max":{"1min":52.587000000000003,"5min":183.512,"15min":183.512},"last":12.666}]},{"osd":2,"last update":"Wed Nov 1 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":23.193000000000001,"5min":26.809999999999999,"15min":22.952000000000002},"min":{"1min":7.0270000000000001,"5min":6.9059999999999997,"15min":6.3600000000000003},"max":{"1min":105.779,"5min":276.858,"15min":276.858},"last":122.467},{"interface":"front","average":{"1min":32.453000000000003,"5min":31.931999999999999,"15min":24.888999999999999},"min":{"1min":7.9779999999999998,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":252.52099999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":149.95599999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":20.033000000000001,"5min":21.949999999999999,"15min":26.713000000000001},"min":{"1min":8.0079999999999991,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":66.866,"5min":77.144000000000005,"15min":327.39800000000002},"last":14.878},{"interface":"front","average":{"1min":23.605,"5min":27.524000000000001,"15min":29.152000000000001},"min":{"1min":7.7480000000000002,"5min":7.2220000000000004,"15min":6.8659999999999997},"max":{"1min":95.472999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":13.461}]},{"osd":4,"last update":"Wed Nov 1 03:40:34 2023","interfaces":[{"interface":"back","average":{"1min":17.314,"5min":19.512,"15min":19.417999999999999},"min":{"1min":8.7159999999999993,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":59.195999999999998,"5min":125.809,"15min":303.637},"last":8.5609999999999999},{"interface":"front","average":{"1min":21.106000000000002,"5min":25.699000000000002,"15min":25.07},"min":{"1min":10.291,"5min":9.1750000000000007,"15min":7.4169999999999998},"max":{"1min":67.885999999999996,"5min":188.06700000000001,"15min":304.79700000000003},"last":14.147}]},{"osd":5,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":19.776,"5min":25.221,"15min":22.968},"min":{"1min":9.952,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":68.028000000000006,"5min":125.69,"15min":143.779},"last":15.500999999999999},{"interface":"front","average":{"1min":21.169,"5min":32.682000000000002,"15min":27.797000000000001},"min":{"1min":10.411,"5min":9.5719999999999992,"15min":8.4670000000000005},"max":{"1min":71.522999999999996,"5min":530.04300000000001,"15min":530.04300000000001},"last":19.120000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":22.713999999999999,"5min":31.914999999999999,"15min":26.495000000000001},"min":{"1min":12.776,"5min":8.2309999999999999,"15min":7.4710000000000001},"max":{"1min":69.022000000000006,"5min":319.23700000000002,"15min":319.23700000000002},"last":17.265999999999998},{"interface":"front","average":{"1min":21.402000000000001,"5min":29.286000000000001,"15min":24.658000000000001},"min":{"1min":10.721,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":57.826999999999998,"5min":193.06299999999999,"15min":193.06299999999999},"last":18.465}]}]},{"osd":4,"up_from":13,"seq":55834575115,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58708,"kb_used_data":5320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313132,"statfs":{"total":96636764160,"available":96576647168,"internally_reserved":0,"allocated":5447680,"data_stored":2927698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.542000000000002,"5min":14.725,"15min":17.497},"min":{"1min":4.8440000000000003,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":98.876000000000005,"5min":101.489,"15min":218.07300000000001},"last":10.119},{"interface":"front","average":{"1min":14.622999999999999,"5min":12.209,"15min":15.000999999999999},"min":{"1min":5.9889999999999999,"5min":5.3129999999999997,"15min":4.7670000000000003},"max":{"1min":111.852,"5min":111.852,"15min":180.934},"last":13.952}]},{"osd":1,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.305,"5min":17.294,"15min":20.532},"min":{"1min":6.9020000000000001,"5min":6.2030000000000003,"15min":5.7309999999999999},"max":{"1min":45.872999999999998,"5min":231.58799999999999,"15min":237.00800000000001},"last":7.1399999999999997},{"interface":"front","average":{"1min":14.226000000000001,"5min":16.335000000000001,"15min":23.113},"min":{"1min":6.8540000000000001,"5min":5.468,"15min":5.468},"max":{"1min":49.228999999999999,"5min":160.93700000000001,"15min":349.45100000000002},"last":11.125999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.260000000000002,"5min":19.155000000000001,"15min":23.353000000000002},"min":{"1min":8.327,"5min":6.9249999999999998,"15min":6.1890000000000001},"max":{"1min":41.594000000000001,"5min":189.38200000000001,"15min":317.30399999999997},"last":20.327000000000002},{"interface":"front","average":{"1min":16.364000000000001,"5min":21.843,"15min":22.341000000000001},"min":{"1min":8.532,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":51.375999999999998,"5min":260.46800000000002,"15min":260.46800000000002},"last":12.567}]},{"osd":3,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":14.776,"5min":18.672000000000001,"15min":23.785},"min":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":54.658000000000001,"5min":165.47200000000001,"15min":421.14600000000002},"last":15.75},{"interface":"front","average":{"1min":19.300000000000001,"5min":19.853999999999999,"15min":26.306999999999999},"min":{"1min":8.3490000000000002,"5min":7.5960000000000001,"15min":7.1429999999999998},"max":{"1min":56.719999999999999,"5min":140.23099999999999,"15min":505.59199999999998},"last":13.224}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":18.914000000000001,"5min":20.149000000000001,"15min":25.367999999999999},"min":{"1min":7.5830000000000002,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":104.053,"5min":137.20500000000001,"15min":326.33499999999998},"last":14.869999999999999},{"interface":"front","average":{"1min":22.571000000000002,"5min":21.366,"15min":26.219000000000001},"min":{"1min":10.512,"5min":9.2110000000000003,"15min":8.7469999999999999},"max":{"1min":113.79900000000001,"5min":133.33000000000001,"15min":272.53399999999999},"last":18.445}]},{"osd":6,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.806000000000001,"5min":23.077000000000002,"15min":24.952999999999999},"min":{"1min":9.5030000000000001,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":47.222000000000001,"5min":350.44400000000002,"15min":483.47500000000002},"last":11.946},{"interface":"front","average":{"1min":20.527000000000001,"5min":27.356000000000002,"15min":31.510999999999999},"min":{"1min":9.9550000000000001,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":35.633000000000003,"5min":351.82100000000003,"15min":585.80600000000004},"last":17.814}]},{"osd":7,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":16.501999999999999,"5min":19.431000000000001,"15min":24.059999999999999},"min":{"1min":10.826000000000001,"5min":7.399,"15min":7.399},"max":{"1min":36.344000000000001,"5min":138.69900000000001,"15min":240.44200000000001},"last":8.8599999999999994},{"interface":"front","average":{"1min":22.460999999999999,"5min":22.478999999999999,"15min":27.318000000000001},"min":{"1min":13.057,"5min":9.907,"15min":8.1669999999999998},"max":{"1min":49.140999999999998,"5min":138.05699999999999,"15min":342.57799999999997},"last":19.091999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:07.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:07.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.511+0000 7f2923ff5640 10 monclient: get_monmap_and_config 2023-11-01T03:41:07.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.511+0000 7f2923ff5640 10 monclient: build_initial_monmap 2023-11-01T03:41:07.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.511+0000 7f2923ff5640 10 monclient: monmap: 2023-11-01T03:41:07.513 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:07.513 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:07.514 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:07.513224+0000 2023-11-01T03:41:07.514 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:07.513224+0000 2023-11-01T03:41:07.514 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:07.514 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:07.515 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.511+0000 7f2923ff5640 1 Processor -- start 2023-11-01T03:41:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 -- start start 2023-11-01T03:41:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient: init 2023-11-01T03:41:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2023-11-01T03:41:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f291c0a8ae0 0x7f291c13ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-a con 0x7f291c0a8ae0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 0x7f291c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-b con 0x7f291c0a8ec0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f291c0b0de0 0x7f291c145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-c con 0x7f291c0b0de0 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0a9360 con 0x7f291c0a8ae0 2023-11-01T03:41:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0a9600 con 0x7f291c0b0de0 2023-11-01T03:41:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0b80b0 con 0x7f291c0a8ec0 2023-11-01T03:41:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.512+0000 7f2923ff5640 10 monclient(hunting): authenticate will time out at 2743.737769s 2023-11-01T03:41:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 0x7f291c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2922592640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f291c0b0de0 0x7f291c145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 0x7f291c13f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46928/0 (socket says 172.21.15.5:46928) 2023-11-01T03:41:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 1 -- 172.21.15.5:0/1629400939 learned_addr learned my addr 172.21.15.5:0/1629400939 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 10 monclient(hunting): get_auth_request con 0x7f291c0a8ec0 auth_method 0 2023-11-01T03:41:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2921590640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2922592640 10 monclient(hunting): get_auth_request con 0x7f291c0b0de0 auth_method 0 2023-11-01T03:41:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2922592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2922592640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.513+0000 7f2922592640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2921590640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2921590640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.514+0000 7f2921590640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.515+0000 7f2922592640 10 monclient(hunting): handle_auth_done global_id 22162 payload 274 2023-11-01T03:41:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.515+0000 7f2922592640 1 -- 172.21.15.5:0/1629400939 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 msgr2=0x7f291c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.515+0000 7f2922592640 1 --2- 172.21.15.5:0/1629400939 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 0x7f291c13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 1 -- 172.21.15.5:0/1629400939 >> v2:172.21.15.5:3300/0 conn(0x7f291c0a8ae0 msgr2=0x7f291c13ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 1 --2- 172.21.15.5:0/1629400939 >> v2:172.21.15.5:3300/0 conn(0x7f291c0a8ae0 0x7f291c13ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 10 monclient: _finish_hunting 0 2023-11-01T03:41:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 1 monclient: found mon.noname-c 2023-11-01T03:41:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:41:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.516+0000 7f2922592640 1 -- 172.21.15.5:0/1629400939 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c145540 con 0x7f291c0b0de0 2023-11-01T03:41:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.518+0000 7f2922592640 1 --2- 172.21.15.5:0/1629400939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0b0de0 0x7f291c145000 secure :-1 s=READY pgs=5542 cs=0 l=1 rev1=1 crypto rx=0x7f291c0aa900 tx=0x7f290c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d2cd34abf1588cb server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 1 -- 172.21.15.5:0/1629400939 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c031830 con 0x7f291c0b0de0 2023-11-01T03:41:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: dump: 2023-11-01T03:41:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:07.532 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: _finish_auth 0 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: _check_auth_tickets 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 1 -- 172.21.15.5:0/1629400939 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c031990 con 0x7f291c0b0de0 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2923ff5640 5 monclient: authenticate success, global_id 22162 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2923ff5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2923ff5640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2923ff5640 4 set_mon_vals no callback set 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 1 -- 172.21.15.5:0/1629400939 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c031d20 con 0x7f291c0b0de0 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.521+0000 7f2920d8f640 10 monclient: dump: 2023-11-01T03:41:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:07.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 10 monclient: shutdown 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 -- 172.21.15.5:0/1629400939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0b0de0 msgr2=0x7f291c145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 --2- 172.21.15.5:0/1629400939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0b0de0 0x7f291c145000 secure :-1 s=READY pgs=5542 cs=0 l=1 rev1=1 crypto rx=0x7f291c0aa900 tx=0x7f290c02b8d0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 -- 172.21.15.5:0/1629400939 shutdown_connections 2023-11-01T03:41:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 --2- 172.21.15.5:0/1629400939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0b0de0 0x7f291c145000 unknown :-1 s=CLOSED pgs=5542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 --2- 172.21.15.5:0/1629400939 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0a8ec0 0x7f291c13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 --2- 172.21.15.5:0/1629400939 >> v2:172.21.15.5:3300/0 conn(0x7f291c0a8ae0 0x7f291c13ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 -- 172.21.15.5:0/1629400939 >> 172.21.15.5:0/1629400939 conn(0x7f291c0b7230 msgr2=0x7f291c0b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 -- 172.21.15.5:0/1629400939 shutdown_connections 2023-11-01T03:41:07.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.522+0000 7f2923ff5640 1 -- 172.21.15.5:0/1629400939 wait complete. 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 10 monclient: build_initial_monmap 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 10 monclient: monmap: 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:07.540 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 librados: starting msgr at 2023-11-01T03:41:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 librados: starting objecter 2023-11-01T03:41:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 Processor -- start 2023-11-01T03:41:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 -- start start 2023-11-01T03:41:07.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 librados: setting wanted keys 2023-11-01T03:41:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 1 librados: calling monclient init 2023-11-01T03:41:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.523+0000 7f2923ff5640 10 monclient: init 2023-11-01T03:41:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:07.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 0x7f291c1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-b con 0x7f291c0a8ae0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c0a8ec0 0x7f291c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-a con 0x7f291c0a8ec0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 0x7f291c140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): picked mon.noname-c con 0x7f291c0b0de0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:07.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c142c30 con 0x7f291c0a8ec0 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c140d40 con 0x7f291c0a8ae0 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c135390 con 0x7f291c0b0de0 2023-11-01T03:41:07.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2923ff5640 10 monclient(hunting): authenticate will time out at 2743.749286s 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2922592640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 0x7f291c140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.524+0000 7f2921d91640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 0x7f291c1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 0x7f291c140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46938/0 (socket says 172.21.15.5:46938) 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 1 -- 172.21.15.5:0/4122116706 learned_addr learned my addr 172.21.15.5:0/4122116706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:07.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): get_auth_request con 0x7f291c0b0de0 auth_method 0 2023-11-01T03:41:07.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:07.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:07.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:07.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): get_auth_request con 0x7f291c0a8ae0 auth_method 0 2023-11-01T03:41:07.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2922592640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:07.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.525+0000 7f2921d91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 10 monclient(hunting): handle_auth_done global_id 22165 payload 824 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 -- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 msgr2=0x7f291c140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 0x7f291c140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 -- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c0a8ec0 msgr2=0x7f291c1402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c0a8ec0 0x7f291c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 10 monclient: _finish_hunting 0 2023-11-01T03:41:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 monclient: found mon.noname-b 2023-11-01T03:41:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:07.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:07.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.528+0000 7f2921d91640 1 -- 172.21.15.5:0/4122116706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009400 con 0x7f291c0a8ae0 2023-11-01T03:41:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.530+0000 7f2921d91640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 0x7f291c1423f0 secure :-1 s=READY pgs=5543 cs=0 l=1 rev1=1 crypto rx=0x7f291400bd70 tx=0x7f291400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.530+0000 7f291a7fc640 10 client.?.objecter ms_handle_connect 0x7f291c0a8ae0 2023-11-01T03:41:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.530+0000 7f291a7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914014440 con 0x7f291c0a8ae0 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: dump: 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:07.554 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140145c0 con 0x7f291c0a8ae0 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 5 monclient: authenticate success, global_id 22165 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 10 monclient: _renew_subs 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c135590 con 0x7f291c0a8ae0 2023-11-01T03:41:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914014970 con 0x7f291c0a8ae0 2023-11-01T03:41:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291a7fc640 10 monclient: dump: 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:07.558 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f291bfff640 4 set_mon_vals no callback set 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 10 client.22165.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 10 monclient: _renew_subs 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c135af0 con 0x7f291c0a8ae0 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.534+0000 7f2923ff5640 1 librados: init done 2023-11-01T03:41:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.535+0000 7f2923ff5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.535+0000 7f2923ff5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.535+0000 7f2923ff5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.535+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c140ee0 con 0x7f291c0a8ae0 2023-11-01T03:41:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.553+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f291401d3b0 con 0x7f291c0a8ae0 2023-11-01T03:41:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.553+0000 7f291a7fc640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 0x7f290806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.553+0000 7f2921590640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 0x7f290806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.553+0000 7f2921590640 10 monclient: get_auth_request con 0x7f290806c800 auth_method 0 2023-11-01T03:41:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.554+0000 7f2921590640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 0x7f290806ecc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f29100094a0 tx=0x7f29100093f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.554+0000 7f291a7fc640 10 client.22165.objecter ms_handle_connect 0x7f290806c800 2023-11-01T03:41:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.556+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 549..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f2914058840 con 0x7f291c0a8ae0 2023-11-01T03:41:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.556+0000 7f291a7fc640 10 client.22165.objecter ms_dispatch 0x7f291c000b90 osd_map(902..902 src has 549..902) v4 2023-11-01T03:41:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.556+0000 7f291a7fc640 3 client.22165.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.556+0000 7f291a7fc640 3 client.22165.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.556+0000 7f291a7fc640 20 client.22165.objecter dump_active .. 0 homeless 2023-11-01T03:41:07.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.791+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2914054b80 con 0x7f291c0a8ae0 2023-11-01T03:41:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.791+0000 7f291a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:07.791+0000 7f291a7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:07.801 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:09.111 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.855 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:09.165 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.888 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:09.198 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.905 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.176 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.907 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.217 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.907 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.179 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.911 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.221 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.936 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.207 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:07.943 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.253 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.008+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f291c140ee0 con 0x7f290806c800 2023-11-01T03:41:08.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.017+0000 7f291a7fc640 1 -- 172.21.15.5:0/4122116706 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151654 (secure 0 0 0) 0x7f291c140ee0 con 0x7f290806c800 2023-11-01T03:41:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:08.020 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.019+0000 7f2923ff5640 10 librados: watch_flush enter 2023-11-01T03:41:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.019+0000 7f2923ff5640 10 librados: watch_flush exit 2023-11-01T03:41:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.019+0000 7f2923ff5640 20 client.22165.objecter shutdown clearing up homeless session... 2023-11-01T03:41:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.019+0000 7f2923ff5640 10 client.22165.objecter successfully canceled tick 2023-11-01T03:41:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.019+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 msgr2=0x7f290806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 0x7f290806ecc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f29100094a0 tx=0x7f29100093f0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 10 monclient: shutdown 2023-11-01T03:41:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 msgr2=0x7f291c1423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 0x7f291c1423f0 secure :-1 s=READY pgs=5543 cs=0 l=1 rev1=1 crypto rx=0x7f291400bd70 tx=0x7f291400be60 comp rx=0 tx=0).stop 2023-11-01T03:41:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 shutdown_connections 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f290806c800 0x7f290806ecc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f291c0b0de0 0x7f291c140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f291c0a8ec0 0x7f291c1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 --2- 172.21.15.5:0/4122116706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0a8ae0 0x7f291c1423f0 unknown :-1 s=CLOSED pgs=5543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 >> 172.21.15.5:0/4122116706 conn(0x7f291c0b7230 msgr2=0x7f291c139910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 shutdown_connections 2023-11-01T03:41:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 -- 172.21.15.5:0/4122116706 wait complete. 2023-11-01T03:41:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.020+0000 7f2923ff5640 1 librados: shutdown 2023-11-01T03:41:08.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1571,"stamp":"2023-11-01T03:41:07.509205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":554844,"kb_used_data":43028,"kb_used_omap":12,"kb_used_meta":511667,"kb_avail":754419876,"statfs":{"total":773094113280,"available":772525953024,"internally_reserved":0,"allocated":44060672,"data_stored":23814127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":523947577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":367,"apply_latency_ms":367,"commit_latency_ns":367000000,"apply_latency_ns":367000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.696192"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.734551+0000","last_change":"2023-11-01T03:20:28.999446+0000","last_active":"2023-11-01T03:41:00.734551+0000","last_peered":"2023-11-01T03:41:00.734551+0000","last_clean":"2023-11-01T03:41:00.734551+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:00.734551+0000","last_undegraded":"2023-11-01T03:41:00.734551+0000","last_fullsized":"2023-11-01T03:41:00.734551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:52:15.750885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.526486+0000","last_change":"2023-11-01T03:20:21.292351+0000","last_active":"2023-11-01T03:41:00.526486+0000","last_peered":"2023-11-01T03:41:00.526486+0000","last_clean":"2023-11-01T03:41:00.526486+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:00.526486+0000","last_undegraded":"2023-11-01T03:41:00.526486+0000","last_fullsized":"2023-11-01T03:41:00.526486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:45.398675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":849,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.708361+0000","last_change":"2023-11-01T03:20:24.849514+0000","last_active":"2023-11-01T03:41:01.708361+0000","last_peered":"2023-11-01T03:41:01.708361+0000","last_clean":"2023-11-01T03:41:01.708361+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:01.708361+0000","last_undegraded":"2023-11-01T03:41:01.708361+0000","last_fullsized":"2023-11-01T03:41:01.708361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:42.030216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.778198+0000","last_change":"2023-11-01T03:20:28.961484+0000","last_active":"2023-11-01T03:41:01.778198+0000","last_peered":"2023-11-01T03:41:01.778198+0000","last_clean":"2023-11-01T03:41:01.778198+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:01.778198+0000","last_undegraded":"2023-11-01T03:41:01.778198+0000","last_fullsized":"2023-11-01T03:41:01.778198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:57:14.344671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.692508+0000","last_change":"2023-11-01T03:20:14.753917+0000","last_active":"2023-11-01T03:41:00.692508+0000","last_peered":"2023-11-01T03:41:00.692508+0000","last_clean":"2023-11-01T03:41:00.692508+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:00.692508+0000","last_undegraded":"2023-11-01T03:41:00.692508+0000","last_fullsized":"2023-11-01T03:41:00.692508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:16:48.817140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":852,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.101313+0000","last_change":"2023-11-01T03:20:19.035194+0000","last_active":"2023-11-01T03:41:05.101313+0000","last_peered":"2023-11-01T03:41:05.101313+0000","last_clean":"2023-11-01T03:41:05.101313+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:05.101313+0000","last_undegraded":"2023-11-01T03:41:05.101313+0000","last_fullsized":"2023-11-01T03:41:05.101313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:36:18.123385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.675805+0000","last_change":"2023-11-01T03:21:04.928879+0000","last_active":"2023-11-01T03:41:01.675805+0000","last_peered":"2023-11-01T03:41:01.675805+0000","last_clean":"2023-11-01T03:41:01.675805+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:01.675805+0000","last_undegraded":"2023-11-01T03:41:01.675805+0000","last_fullsized":"2023-11-01T03:41:01.675805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:59:54.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":852,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.117205+0000","last_change":"2023-11-01T03:20:17.044459+0000","last_active":"2023-11-01T03:41:05.117205+0000","last_peered":"2023-11-01T03:41:05.117205+0000","last_clean":"2023-11-01T03:41:05.117205+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:05.117205+0000","last_undegraded":"2023-11-01T03:41:05.117205+0000","last_fullsized":"2023-11-01T03:41:05.117205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:12:42.352566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.947434+0000","last_change":"2023-11-01T03:20:21.310132+0000","last_active":"2023-11-01T03:41:02.947434+0000","last_peered":"2023-11-01T03:41:02.947434+0000","last_clean":"2023-11-01T03:41:02.947434+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:02.947434+0000","last_undegraded":"2023-11-01T03:41:02.947434+0000","last_fullsized":"2023-11-01T03:41:02.947434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:50:11.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.528113+0000","last_change":"2023-11-01T03:20:21.284659+0000","last_active":"2023-11-01T03:41:00.528113+0000","last_peered":"2023-11-01T03:41:00.528113+0000","last_clean":"2023-11-01T03:41:00.528113+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:00.528113+0000","last_undegraded":"2023-11-01T03:41:00.528113+0000","last_fullsized":"2023-11-01T03:41:00.528113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:27:21.187272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.986156+0000","last_change":"2023-11-01T03:20:24.027089+0000","last_active":"2023-11-01T03:41:02.986156+0000","last_peered":"2023-11-01T03:41:02.986156+0000","last_clean":"2023-11-01T03:41:02.986156+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:02.986156+0000","last_undegraded":"2023-11-01T03:41:02.986156+0000","last_fullsized":"2023-11-01T03:41:02.986156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:29:01.442024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.999907+0000","last_change":"2023-11-01T03:20:25.928340+0000","last_active":"2023-11-01T03:41:02.999907+0000","last_peered":"2023-11-01T03:41:02.999907+0000","last_clean":"2023-11-01T03:41:02.999907+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:02.999907+0000","last_undegraded":"2023-11-01T03:41:02.999907+0000","last_fullsized":"2023-11-01T03:41:02.999907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:44:04.520733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.570862+0000","last_change":"2023-11-01T03:20:21.132613+0000","last_active":"2023-11-01T03:41:01.570862+0000","last_peered":"2023-11-01T03:41:01.570862+0000","last_clean":"2023-11-01T03:41:01.570862+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:01.570862+0000","last_undegraded":"2023-11-01T03:41:01.570862+0000","last_fullsized":"2023-11-01T03:41:01.570862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:14:39.509557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.746532+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:41:00.746532+0000","last_peered":"2023-11-01T03:41:00.746532+0000","last_clean":"2023-11-01T03:41:00.746532+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:00.746532+0000","last_undegraded":"2023-11-01T03:41:00.746532+0000","last_fullsized":"2023-11-01T03:41:00.746532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":854,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.736259+0000","last_change":"2023-11-01T03:20:20.628315+0000","last_active":"2023-11-01T03:41:00.736259+0000","last_peered":"2023-11-01T03:41:00.736259+0000","last_clean":"2023-11-01T03:41:00.736259+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:00.736259+0000","last_undegraded":"2023-11-01T03:41:00.736259+0000","last_fullsized":"2023-11-01T03:41:00.736259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:13:44.355143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":858,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.093560+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:41:05.093560+0000","last_peered":"2023-11-01T03:41:05.093560+0000","last_clean":"2023-11-01T03:41:05.093560+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:05.093560+0000","last_undegraded":"2023-11-01T03:41:05.093560+0000","last_fullsized":"2023-11-01T03:41:05.093560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:05:15.577920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.715332+0000","last_change":"2023-11-01T03:20:22.257051+0000","last_active":"2023-11-01T03:41:01.715332+0000","last_peered":"2023-11-01T03:41:01.715332+0000","last_clean":"2023-11-01T03:41:01.715332+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:01.715332+0000","last_undegraded":"2023-11-01T03:41:01.715332+0000","last_fullsized":"2023-11-01T03:41:01.715332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:59:19.002962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.738593+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:41:00.738593+0000","last_peered":"2023-11-01T03:41:00.738593+0000","last_clean":"2023-11-01T03:41:00.738593+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:00.738593+0000","last_undegraded":"2023-11-01T03:41:00.738593+0000","last_fullsized":"2023-11-01T03:41:00.738593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.740155+0000","last_change":"2023-11-01T03:20:24.831827+0000","last_active":"2023-11-01T03:41:01.740155+0000","last_peered":"2023-11-01T03:41:01.740155+0000","last_clean":"2023-11-01T03:41:01.740155+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:01.740155+0000","last_undegraded":"2023-11-01T03:41:01.740155+0000","last_fullsized":"2023-11-01T03:41:01.740155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:48:19.626083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":867,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.529764+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:41:00.529764+0000","last_peered":"2023-11-01T03:41:00.529764+0000","last_clean":"2023-11-01T03:41:00.529764+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:00.529764+0000","last_undegraded":"2023-11-01T03:41:00.529764+0000","last_fullsized":"2023-11-01T03:41:00.529764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.509242+0000","last_change":"2023-11-01T03:20:38.569214+0000","last_active":"2023-11-01T03:41:00.509242+0000","last_peered":"2023-11-01T03:41:00.509242+0000","last_clean":"2023-11-01T03:41:00.509242+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:00.509242+0000","last_undegraded":"2023-11-01T03:41:00.509242+0000","last_fullsized":"2023-11-01T03:41:00.509242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:01:54.979113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.712229+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:41:00.712229+0000","last_peered":"2023-11-01T03:41:00.712229+0000","last_clean":"2023-11-01T03:41:00.712229+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:00.712229+0000","last_undegraded":"2023-11-01T03:41:00.712229+0000","last_fullsized":"2023-11-01T03:41:00.712229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":853,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.114079+0000","last_change":"2023-11-01T03:20:28.854647+0000","last_active":"2023-11-01T03:41:05.114079+0000","last_peered":"2023-11-01T03:41:05.114079+0000","last_clean":"2023-11-01T03:41:05.114079+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:05.114079+0000","last_undegraded":"2023-11-01T03:41:05.114079+0000","last_fullsized":"2023-11-01T03:41:05.114079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:21:38.217969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":856,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.578031+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:41:01.578031+0000","last_peered":"2023-11-01T03:41:01.578031+0000","last_clean":"2023-11-01T03:41:01.578031+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:01.578031+0000","last_undegraded":"2023-11-01T03:41:01.578031+0000","last_fullsized":"2023-11-01T03:41:01.578031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.518598+0000","last_change":"2023-11-01T03:20:27.836705+0000","last_active":"2023-11-01T03:41:00.518598+0000","last_peered":"2023-11-01T03:41:00.518598+0000","last_clean":"2023-11-01T03:41:00.518598+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:00.518598+0000","last_undegraded":"2023-11-01T03:41:00.518598+0000","last_fullsized":"2023-11-01T03:41:00.518598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:24:51.036742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.668334+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:41:00.668334+0000","last_peered":"2023-11-01T03:41:00.668334+0000","last_clean":"2023-11-01T03:41:00.668334+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:00.668334+0000","last_undegraded":"2023-11-01T03:41:00.668334+0000","last_fullsized":"2023-11-01T03:41:00.668334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.501088+0000","last_change":"2023-11-01T03:20:25.561602+0000","last_active":"2023-11-01T03:41:00.501088+0000","last_peered":"2023-11-01T03:41:00.501088+0000","last_clean":"2023-11-01T03:41:00.501088+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:00.501088+0000","last_undegraded":"2023-11-01T03:41:00.501088+0000","last_fullsized":"2023-11-01T03:41:00.501088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:09:15.818152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.724979+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:41:00.724979+0000","last_peered":"2023-11-01T03:41:00.724979+0000","last_clean":"2023-11-01T03:41:00.724979+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:00.724979+0000","last_undegraded":"2023-11-01T03:41:00.724979+0000","last_fullsized":"2023-11-01T03:41:00.724979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":964,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.104516+0000","last_change":"2023-11-01T03:19:01.879653+0000","last_active":"2023-11-01T03:41:05.104516+0000","last_peered":"2023-11-01T03:41:05.104516+0000","last_clean":"2023-11-01T03:41:05.104516+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:05.104516+0000","last_undegraded":"2023-11-01T03:41:05.104516+0000","last_fullsized":"2023-11-01T03:41:05.104516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_clean_scrub_stamp":"2023-11-01T03:18:57.938958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:10:19.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":868,"reported_epoch":900,"state":"active+clean","last_fresh":"2023-11-01T03:41:04.319158+0000","last_change":"2023-11-01T03:20:23.770784+0000","last_active":"2023-11-01T03:41:04.319158+0000","last_peered":"2023-11-01T03:41:04.319158+0000","last_clean":"2023-11-01T03:41:04.319158+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:04.319158+0000","last_undegraded":"2023-11-01T03:41:04.319158+0000","last_fullsized":"2023-11-01T03:41:04.319158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:52:35.620928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.711889+0000","last_change":"2023-11-01T03:20:16.655844+0000","last_active":"2023-11-01T03:41:01.711889+0000","last_peered":"2023-11-01T03:41:01.711889+0000","last_clean":"2023-11-01T03:41:01.711889+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:01.711889+0000","last_undegraded":"2023-11-01T03:41:01.711889+0000","last_fullsized":"2023-11-01T03:41:01.711889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:09:46.488826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":863,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.504037+0000","last_change":"2023-11-01T03:20:27.628859+0000","last_active":"2023-11-01T03:41:00.504037+0000","last_peered":"2023-11-01T03:41:00.504037+0000","last_clean":"2023-11-01T03:41:00.504037+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:00.504037+0000","last_undegraded":"2023-11-01T03:41:00.504037+0000","last_fullsized":"2023-11-01T03:41:00.504037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:50:18.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"39'7","reported_seq":865,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:03.328908+0000","last_change":"2023-11-01T03:20:16.772503+0000","last_active":"2023-11-01T03:41:03.328908+0000","last_peered":"2023-11-01T03:41:03.328908+0000","last_clean":"2023-11-01T03:41:03.328908+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:03.328908+0000","last_undegraded":"2023-11-01T03:41:03.328908+0000","last_fullsized":"2023-11-01T03:41:03.328908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:41:51.271420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.717542+0000","last_change":"2023-11-01T03:20:20.690944+0000","last_active":"2023-11-01T03:41:01.717542+0000","last_peered":"2023-11-01T03:41:01.717542+0000","last_clean":"2023-11-01T03:41:01.717542+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:01.717542+0000","last_undegraded":"2023-11-01T03:41:01.717542+0000","last_fullsized":"2023-11-01T03:41:01.717542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:55:05.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.741885+0000","last_change":"2023-11-01T03:20:31.376540+0000","last_active":"2023-11-01T03:41:01.741885+0000","last_peered":"2023-11-01T03:41:01.741885+0000","last_clean":"2023-11-01T03:41:01.741885+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:01.741885+0000","last_undegraded":"2023-11-01T03:41:01.741885+0000","last_fullsized":"2023-11-01T03:41:01.741885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:48:22.668122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.572774+0000","last_change":"2023-11-01T03:20:15.800818+0000","last_active":"2023-11-01T03:41:01.572774+0000","last_peered":"2023-11-01T03:41:01.572774+0000","last_clean":"2023-11-01T03:41:01.572774+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:01.572774+0000","last_undegraded":"2023-11-01T03:41:01.572774+0000","last_fullsized":"2023-11-01T03:41:01.572774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:20:00.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.533702+0000","last_change":"2023-11-01T03:20:38.737137+0000","last_active":"2023-11-01T03:41:00.533702+0000","last_peered":"2023-11-01T03:41:00.533702+0000","last_clean":"2023-11-01T03:41:00.533702+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:00.533702+0000","last_undegraded":"2023-11-01T03:41:00.533702+0000","last_fullsized":"2023-11-01T03:41:00.533702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:57:06.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.510928+0000","last_change":"2023-11-01T03:20:21.863000+0000","last_active":"2023-11-01T03:41:00.510928+0000","last_peered":"2023-11-01T03:41:00.510928+0000","last_clean":"2023-11-01T03:41:00.510928+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:00.510928+0000","last_undegraded":"2023-11-01T03:41:00.510928+0000","last_fullsized":"2023-11-01T03:41:00.510928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:08:06.676287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":853,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.104747+0000","last_change":"2023-11-01T03:20:21.943627+0000","last_active":"2023-11-01T03:41:05.104747+0000","last_peered":"2023-11-01T03:41:05.104747+0000","last_clean":"2023-11-01T03:41:05.104747+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:05.104747+0000","last_undegraded":"2023-11-01T03:41:05.104747+0000","last_fullsized":"2023-11-01T03:41:05.104747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:31:18.289912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.661847+0000","last_change":"2023-11-01T03:20:31.359278+0000","last_active":"2023-11-01T03:41:01.661847+0000","last_peered":"2023-11-01T03:41:01.661847+0000","last_clean":"2023-11-01T03:41:01.661847+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:01.661847+0000","last_undegraded":"2023-11-01T03:41:01.661847+0000","last_fullsized":"2023-11-01T03:41:01.661847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:03:02.004192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.886975+0000","last_change":"2023-11-01T03:20:20.196742+0000","last_active":"2023-11-01T03:41:02.886975+0000","last_peered":"2023-11-01T03:41:02.886975+0000","last_clean":"2023-11-01T03:41:02.886975+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:02.886975+0000","last_undegraded":"2023-11-01T03:41:02.886975+0000","last_fullsized":"2023-11-01T03:41:02.886975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:20:43.175812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58612,"kb_used_data":5224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313228,"statfs":{"total":96636764160,"available":96576745472,"internally_reserved":0,"allocated":5349376,"data_stored":2829167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":9.9390000000000001},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":11.432}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":10.82},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":24.141999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":31.701000000000001},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":22.506}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":7.7329999999999997},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":20.841999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":23.494},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":18.329000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":26.986000000000001},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":30.585999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":36.545000000000002},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":25.515999999999998}]}]},{"osd":1,"up_from":16,"seq":68719477002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81276,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290564,"statfs":{"total":96636764160,"available":96553537536,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":26.581,"5min":15.032,"15min":17.754000000000001},"min":{"1min":6.7830000000000004,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":202.77600000000001,"5min":202.77600000000001,"15min":233.18799999999999},"last":7.0890000000000004},{"interface":"front","average":{"1min":25.585000000000001,"5min":17.437000000000001,"15min":20.001000000000001},"min":{"1min":8.0950000000000006,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":211.577,"5min":211.577,"15min":227.72900000000001},"last":17.59}]},{"osd":2,"last update":"Wed Nov 1 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":15.635,"5min":19.303000000000001,"15min":23.484999999999999},"min":{"1min":7.8239999999999998,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":62.979999999999997,"5min":157.964,"15min":226.35300000000001},"last":14.762},{"interface":"front","average":{"1min":16.472000000000001,"5min":21.312000000000001,"15min":22.969000000000001},"min":{"1min":8.7490000000000006,"5min":7.649,"15min":6.7699999999999996},"max":{"1min":44.670999999999999,"5min":230.01499999999999,"15min":230.01499999999999},"last":10.039}]},{"osd":3,"last update":"Wed Nov 1 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":22.356000000000002,"5min":19.739999999999998,"15min":26.463000000000001},"min":{"1min":9.2609999999999992,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":139.18199999999999,"5min":139.18199999999999,"15min":301.214},"last":12.221},{"interface":"front","average":{"1min":20.103999999999999,"5min":16.913,"15min":23.349},"min":{"1min":7.2690000000000001,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":158.572,"5min":167.44900000000001,"15min":289.25400000000002},"last":7.9770000000000003}]},{"osd":4,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":25.346,"5min":19.154,"15min":21.763999999999999},"min":{"1min":6.8310000000000004,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":92.372,"5min":92.372,"15min":228.119},"last":16.934999999999999},{"interface":"front","average":{"1min":21.606000000000002,"5min":17.113,"15min":22.614999999999998},"min":{"1min":6.8810000000000002,"5min":6.7969999999999997,"15min":6.7969999999999997},"max":{"1min":82.914000000000001,"5min":82.914000000000001,"15min":265.774},"last":11.425000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":20.431999999999999,"5min":21.949999999999999,"15min":26.109999999999999},"min":{"1min":7.234,"5min":7.234,"15min":7.234},"max":{"1min":47.537999999999997,"5min":104.411,"15min":277.53100000000001},"last":21.442},{"interface":"front","average":{"1min":18.678999999999998,"5min":21.218,"15min":25.378},"min":{"1min":7.9809999999999999,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":86.488,"5min":107.372,"15min":270.26400000000001},"last":23.841999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.664999999999999,"5min":22.835999999999999,"15min":26.817},"min":{"1min":10.542999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":55.893000000000001,"5min":111.179,"15min":240.887},"last":12.923},{"interface":"front","average":{"1min":22.527999999999999,"5min":26.219999999999999,"15min":29.495999999999999},"min":{"1min":14.475,"5min":13.331,"15min":10.785},"max":{"1min":59.003999999999998,"5min":144.75399999999999,"15min":271.04899999999998},"last":20.157}]},{"osd":7,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.878,"5min":17.433,"15min":26.861000000000001},"min":{"1min":9.0549999999999997,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":88.796000000000006,"5min":88.796000000000006,"15min":348.608},"last":19.803000000000001},{"interface":"front","average":{"1min":24.318999999999999,"5min":24.468,"15min":31.408000000000001},"min":{"1min":15.694000000000001,"5min":12.734999999999999,"15min":11.98},"max":{"1min":89.978999999999999,"5min":104.134,"15min":345.22899999999998},"last":13.52}]}]},{"osd":3,"up_from":16,"seq":68719477001,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76716,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295124,"statfs":{"total":96636764160,"available":96558206976,"internally_reserved":0,"allocated":5398528,"data_stored":2878319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":11.449},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":10.776999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":7.9649999999999999},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":8.4559999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":13.223000000000001},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":8.8819999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":12.593999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":13.981}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":18.126999999999999},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":16.663}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":14.612},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":15.348000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":15.976000000000001},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":17.323}]}]},{"osd":0,"up_from":16,"seq":68719477002,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62852,"kb_used_data":5300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308988,"statfs":{"total":96636764160,"available":96572403712,"internally_reserved":0,"allocated":5427200,"data_stored":2898189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":15.183,"5min":13.965999999999999,"15min":20.741},"min":{"1min":8.4350000000000005,"5min":6.2430000000000003,"15min":5.0919999999999996},"max":{"1min":29.344000000000001,"5min":63.280000000000001,"15min":193.87200000000001},"last":8.9359999999999999},{"interface":"front","average":{"1min":13.127000000000001,"5min":13.782,"15min":19.478999999999999},"min":{"1min":6.4610000000000003,"5min":6.0229999999999997,"15min":6.0179999999999998},"max":{"1min":41.377000000000002,"5min":61.674999999999997,"15min":208.66800000000001},"last":9.7989999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.792000000000002,"5min":17.826000000000001,"15min":24.395},"min":{"1min":9.9939999999999998,"5min":8.1379999999999999,"15min":6.657},"max":{"1min":31.626000000000001,"5min":93.488,"15min":238.64400000000001},"last":12.885},{"interface":"front","average":{"1min":16.863,"5min":16.988,"15min":21.623000000000001},"min":{"1min":7.1680000000000001,"5min":6.8760000000000003,"15min":6.2300000000000004},"max":{"1min":50.618000000000002,"5min":102.666,"15min":272.35500000000002},"last":12.161}]},{"osd":3,"last update":"Wed Nov 1 03:40:51 2023","interfaces":[{"interface":"back","average":{"1min":16.027999999999999,"5min":15.141999999999999,"15min":25.698},"min":{"1min":7.6429999999999998,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":67.299999999999997,"5min":67.299999999999997,"15min":285.99099999999999},"last":10.35},{"interface":"front","average":{"1min":22.164000000000001,"5min":21.707000000000001,"15min":27.375},"min":{"1min":10.720000000000001,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":66.314999999999998,"5min":216.52000000000001,"15min":334.51100000000002},"last":13.898999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.289999999999999,"5min":20.956,"15min":24.43},"min":{"1min":11.702,"5min":7.5789999999999997,"15min":7.5789999999999997},"max":{"1min":38.886000000000003,"5min":206.935,"15min":206.935},"last":17.504999999999999},{"interface":"front","average":{"1min":18.594999999999999,"5min":18.873999999999999,"15min":25.129999999999999},"min":{"1min":11.151,"5min":6.867,"15min":6.867},"max":{"1min":51.771999999999998,"5min":143.786,"15min":259.03399999999999},"last":8.2409999999999997}]},{"osd":5,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.010999999999999,"5min":21.155000000000001,"15min":22.881},"min":{"1min":6.7779999999999996,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.651000000000003,"5min":178.88300000000001,"15min":225.07300000000001},"last":11.311999999999999},{"interface":"front","average":{"1min":22.504000000000001,"5min":25.228999999999999,"15min":26.687999999999999},"min":{"1min":13.220000000000001,"5min":11.926,"15min":8.423},"max":{"1min":50.25,"5min":178.24199999999999,"15min":198.66900000000001},"last":14.567}]},{"osd":6,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":20.844000000000001,"15min":28.954999999999998},"min":{"1min":9.218,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":53.276000000000003,"5min":177.26900000000001,"15min":450.18599999999998},"last":16.591999999999999},{"interface":"front","average":{"1min":24.831,"5min":24.460000000000001,"15min":31.073},"min":{"1min":15.340999999999999,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":51.051000000000002,"5min":91.165999999999997,"15min":282.93000000000001},"last":19.184999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":22.015000000000001,"5min":23.861999999999998,"15min":27.366},"min":{"1min":9.5079999999999991,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":52.453000000000003,"5min":144.767,"15min":230.99600000000001},"last":15.206},{"interface":"front","average":{"1min":24.102,"5min":25.707999999999998,"15min":30.646000000000001},"min":{"1min":10.026999999999999,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":45.552,"5min":148.28200000000001,"15min":226.959},"last":18.347999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509707,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77100,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294740,"statfs":{"total":96636764160,"available":96557813760,"internally_reserved":0,"allocated":5791744,"data_stored":3267967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":10.679,"5min":14.500999999999999,"15min":18.439},"min":{"1min":4.9640000000000004,"5min":4.444,"15min":4.444},"max":{"1min":20.597999999999999,"5min":70.945999999999998,"15min":231.386},"last":91.474999999999994},{"interface":"front","average":{"1min":10.138,"5min":16.434999999999999,"15min":21.382999999999999},"min":{"1min":5.0300000000000002,"5min":4.5090000000000003,"15min":4.5090000000000003},"max":{"1min":18.754999999999999,"5min":111.236,"15min":229.50299999999999},"last":49.658000000000001}]},{"osd":1,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.744999999999999,"5min":20.986999999999998,"15min":23.802},"min":{"1min":6.3540000000000001,"5min":6.0179999999999998,"15min":5.3780000000000001},"max":{"1min":58.527999999999999,"5min":302.94099999999997,"15min":328.08199999999999},"last":120.39},{"interface":"front","average":{"1min":18.532,"5min":27.169,"15min":31.489000000000001},"min":{"1min":8.2050000000000001,"5min":7.6340000000000003,"15min":7.6340000000000003},"max":{"1min":60.542999999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":124.95399999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":15.901,"5min":22.568000000000001,"15min":23.664999999999999},"min":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":34.584000000000003,"5min":195.53700000000001,"15min":195.53700000000001},"last":45.817999999999998},{"interface":"front","average":{"1min":13.531000000000001,"5min":22.632000000000001,"15min":22.719000000000001},"min":{"1min":6.4530000000000003,"5min":6.4109999999999996,"15min":6.0259999999999998},"max":{"1min":20.637,"5min":252.57900000000001,"15min":252.57900000000001},"last":44.540999999999997}]},{"osd":3,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":15.587,"5min":25.533000000000001,"15min":30.013000000000002},"min":{"1min":9.452,"5min":6.383,"15min":6.383},"max":{"1min":22.768000000000001,"5min":226.05600000000001,"15min":726.51099999999997},"last":53.186},{"interface":"front","average":{"1min":15.470000000000001,"5min":26.940000000000001,"15min":31.023},"min":{"1min":10.199,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":25.969999999999999,"5min":186.75999999999999,"15min":784.01700000000005},"last":37.101999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.624000000000001,"5min":24.079999999999998,"15min":27.091999999999999},"min":{"1min":7.2830000000000004,"5min":7.2530000000000001,"15min":6.8979999999999997},"max":{"1min":28.57,"5min":158.505,"15min":327.47699999999998},"last":121.00700000000001},{"interface":"front","average":{"1min":17.361999999999998,"5min":27.986999999999998,"15min":30.132000000000001},"min":{"1min":9.1989999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":29.838000000000001,"5min":205.315,"15min":315.95100000000002},"last":38.863}]},{"osd":6,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":16.306999999999999,"5min":27.713999999999999,"15min":28.725000000000001},"min":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":29.844999999999999,"5min":171.857,"15min":249.559},"last":94.876000000000005},{"interface":"front","average":{"1min":14.456,"5min":27.353999999999999,"15min":31.786999999999999},"min":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":24.298999999999999,"5min":182.077,"15min":383.42099999999999},"last":133.702}]},{"osd":7,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":17.582000000000001,"5min":25.562000000000001,"15min":28.114999999999998},"min":{"1min":11.412000000000001,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":32.265999999999998,"5min":170.60599999999999,"15min":215.22399999999999},"last":42.237000000000002},{"interface":"front","average":{"1min":17.917000000000002,"5min":24.146000000000001,"15min":27.420000000000002},"min":{"1min":11.912000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":30.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":48.853000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542411,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5398528,"data_stored":2874228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":22.065000000000001,"5min":24.597999999999999,"15min":21.370999999999999},"min":{"1min":5.3769999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":132.393,"5min":205.869,"15min":205.869},"last":11.029},{"interface":"front","average":{"1min":23.149999999999999,"5min":28.571999999999999,"15min":25.462},"min":{"1min":10.762,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":146.113,"5min":248.73099999999999,"15min":248.73099999999999},"last":16.672999999999998}]},{"osd":1,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":12.084,"5min":21.053999999999998,"15min":23.530000000000001},"min":{"1min":6.6020000000000003,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":61.753,"5min":272.86900000000003,"15min":272.86900000000003},"last":7.4829999999999997},{"interface":"front","average":{"1min":28.754999999999999,"5min":28.062000000000001,"15min":28.823},"min":{"1min":9.8300000000000001,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":267.911,"5min":267.911,"15min":352.642},"last":14.414}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":17.931000000000001,"5min":24.111999999999998,"15min":24.303999999999998},"min":{"1min":8.8209999999999997,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":62.329000000000001,"5min":153.25399999999999,"15min":167.721},"last":15.112},{"interface":"front","average":{"1min":17.760999999999999,"5min":20.530999999999999,"15min":22.216000000000001},"min":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":71.908000000000001,"5min":156.71199999999999,"15min":317.15300000000002},"last":9.8070000000000004}]},{"osd":3,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":19.149999999999999,"5min":28.553999999999998,"15min":28.556000000000001},"min":{"1min":9.6020000000000003,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":66.546000000000006,"5min":207.48699999999999,"15min":864.23099999999999},"last":12.93},{"interface":"front","average":{"1min":25.015999999999998,"5min":25.204000000000001,"15min":21.548999999999999},"min":{"1min":6.2699999999999996,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":136.334,"5min":210.626,"15min":263.649},"last":9.0640000000000001}]},{"osd":4,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.088000000000001,"5min":27.611000000000001,"15min":24.763000000000002},"min":{"1min":11.535,"5min":7.6989999999999998,"15min":7.2000000000000002},"max":{"1min":89.551000000000002,"5min":159.137,"15min":168.39099999999999},"last":18.556000000000001},{"interface":"front","average":{"1min":16.887,"5min":23.902999999999999,"15min":21.550000000000001},"min":{"1min":9.5350000000000001,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":81.560000000000002,"5min":160.304,"15min":160.304},"last":12.242000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.786999999999999,"5min":27.809999999999999,"15min":23.050000000000001},"min":{"1min":11.93,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":80.522999999999996,"5min":155.24299999999999,"15min":270.94600000000003},"last":17.510000000000002},{"interface":"front","average":{"1min":18.129000000000001,"5min":25.039000000000001,"15min":26.381},"min":{"1min":10.413,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":65.290999999999997,"5min":153.74199999999999,"15min":272.613},"last":13.592000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":14.641999999999999,"5min":18.841000000000001,"15min":20.309000000000001},"min":{"1min":6.798,"5min":6.3719999999999999,"15min":5.9080000000000004},"max":{"1min":99.433000000000007,"5min":153.58699999999999,"15min":204.26400000000001},"last":28.861999999999998},{"interface":"front","average":{"1min":22.571999999999999,"5min":28.119,"15min":29.311},"min":{"1min":11.381,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":94.052999999999997,"5min":176.62899999999999,"15min":187.38900000000001},"last":19.486000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575116,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80956,"kb_used_data":5360,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290884,"statfs":{"total":96636764160,"available":96553865216,"internally_reserved":0,"allocated":5488640,"data_stored":2959629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":14.619,"5min":18.068999999999999,"15min":17.006},"min":{"1min":4.7889999999999997,"5min":4.4829999999999997,"15min":4.431},"max":{"1min":74.355000000000004,"5min":182.16200000000001,"15min":215.01400000000001},"last":6.7119999999999997},{"interface":"front","average":{"1min":15.571999999999999,"5min":18.236999999999998,"15min":17.800999999999998},"min":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":70.613,"5min":165.08500000000001,"15min":208.00800000000001},"last":11.363}]},{"osd":1,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":18.352,"5min":26.658000000000001,"15min":23.210000000000001},"min":{"1min":5.6749999999999998,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":120.19799999999999,"5min":508.113,"15min":508.113},"last":10.365},{"interface":"front","average":{"1min":14.755000000000001,"5min":21.356999999999999,"15min":19.134},"min":{"1min":6.5369999999999999,"5min":6.4210000000000003,"15min":5.1879999999999997},"max":{"1min":52.587000000000003,"5min":183.512,"15min":183.512},"last":12.666}]},{"osd":2,"last update":"Wed Nov 1 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":23.193000000000001,"5min":26.809999999999999,"15min":22.952000000000002},"min":{"1min":7.0270000000000001,"5min":6.9059999999999997,"15min":6.3600000000000003},"max":{"1min":105.779,"5min":276.858,"15min":276.858},"last":122.467},{"interface":"front","average":{"1min":32.453000000000003,"5min":31.931999999999999,"15min":24.888999999999999},"min":{"1min":7.9779999999999998,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":252.52099999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":149.95599999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":20.033000000000001,"5min":21.949999999999999,"15min":26.713000000000001},"min":{"1min":8.0079999999999991,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":66.866,"5min":77.144000000000005,"15min":327.39800000000002},"last":14.878},{"interface":"front","average":{"1min":23.605,"5min":27.524000000000001,"15min":29.152000000000001},"min":{"1min":7.7480000000000002,"5min":7.2220000000000004,"15min":6.8659999999999997},"max":{"1min":95.472999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":13.461}]},{"osd":4,"last update":"Wed Nov 1 03:40:34 2023","interfaces":[{"interface":"back","average":{"1min":17.314,"5min":19.512,"15min":19.417999999999999},"min":{"1min":8.7159999999999993,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":59.195999999999998,"5min":125.809,"15min":303.637},"last":8.5609999999999999},{"interface":"front","average":{"1min":21.106000000000002,"5min":25.699000000000002,"15min":25.07},"min":{"1min":10.291,"5min":9.1750000000000007,"15min":7.4169999999999998},"max":{"1min":67.885999999999996,"5min":188.06700000000001,"15min":304.79700000000003},"last":14.147}]},{"osd":5,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":19.776,"5min":25.221,"15min":22.968},"min":{"1min":9.952,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":68.028000000000006,"5min":125.69,"15min":143.779},"last":15.500999999999999},{"interface":"front","average":{"1min":21.169,"5min":32.682000000000002,"15min":27.797000000000001},"min":{"1min":10.411,"5min":9.5719999999999992,"15min":8.4670000000000005},"max":{"1min":71.522999999999996,"5min":530.04300000000001,"15min":530.04300000000001},"last":19.120000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":22.713999999999999,"5min":31.914999999999999,"15min":26.495000000000001},"min":{"1min":12.776,"5min":8.2309999999999999,"15min":7.4710000000000001},"max":{"1min":69.022000000000006,"5min":319.23700000000002,"15min":319.23700000000002},"last":17.265999999999998},{"interface":"front","average":{"1min":21.402000000000001,"5min":29.286000000000001,"15min":24.658000000000001},"min":{"1min":10.721,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":57.826999999999998,"5min":193.06299999999999,"15min":193.06299999999999},"last":18.465}]}]},{"osd":4,"up_from":13,"seq":55834575116,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58664,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313176,"statfs":{"total":96636764160,"available":96576692224,"internally_reserved":0,"allocated":5398528,"data_stored":2850715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.542000000000002,"5min":14.725,"15min":17.497},"min":{"1min":4.8440000000000003,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":98.876000000000005,"5min":101.489,"15min":218.07300000000001},"last":18.940000000000001},{"interface":"front","average":{"1min":14.622999999999999,"5min":12.209,"15min":15.000999999999999},"min":{"1min":5.9889999999999999,"5min":5.3129999999999997,"15min":4.7670000000000003},"max":{"1min":111.852,"5min":111.852,"15min":180.934},"last":13.56}]},{"osd":1,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.305,"5min":17.294,"15min":20.532},"min":{"1min":6.9020000000000001,"5min":6.2030000000000003,"15min":5.7309999999999999},"max":{"1min":45.872999999999998,"5min":231.58799999999999,"15min":237.00800000000001},"last":7.3700000000000001},{"interface":"front","average":{"1min":14.226000000000001,"5min":16.335000000000001,"15min":23.113},"min":{"1min":6.8540000000000001,"5min":5.468,"15min":5.468},"max":{"1min":49.228999999999999,"5min":160.93700000000001,"15min":349.45100000000002},"last":17.350999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.260000000000002,"5min":19.155000000000001,"15min":23.353000000000002},"min":{"1min":8.327,"5min":6.9249999999999998,"15min":6.1890000000000001},"max":{"1min":41.594000000000001,"5min":189.38200000000001,"15min":317.30399999999997},"last":11.358000000000001},{"interface":"front","average":{"1min":16.364000000000001,"5min":21.843,"15min":22.341000000000001},"min":{"1min":8.532,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":51.375999999999998,"5min":260.46800000000002,"15min":260.46800000000002},"last":16.312999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":14.776,"5min":18.672000000000001,"15min":23.785},"min":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":54.658000000000001,"5min":165.47200000000001,"15min":421.14600000000002},"last":10.069000000000001},{"interface":"front","average":{"1min":19.300000000000001,"5min":19.853999999999999,"15min":26.306999999999999},"min":{"1min":8.3490000000000002,"5min":7.5960000000000001,"15min":7.1429999999999998},"max":{"1min":56.719999999999999,"5min":140.23099999999999,"15min":505.59199999999998},"last":8.2330000000000005}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":18.914000000000001,"5min":20.149000000000001,"15min":25.367999999999999},"min":{"1min":7.5830000000000002,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":104.053,"5min":137.20500000000001,"15min":326.33499999999998},"last":19.914000000000001},{"interface":"front","average":{"1min":22.571000000000002,"5min":21.366,"15min":26.219000000000001},"min":{"1min":10.512,"5min":9.2110000000000003,"15min":8.7469999999999999},"max":{"1min":113.79900000000001,"5min":133.33000000000001,"15min":272.53399999999999},"last":12.712999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.806000000000001,"5min":23.077000000000002,"15min":24.952999999999999},"min":{"1min":9.5030000000000001,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":47.222000000000001,"5min":350.44400000000002,"15min":483.47500000000002},"last":10.680999999999999},{"interface":"front","average":{"1min":20.527000000000001,"5min":27.356000000000002,"15min":31.510999999999999},"min":{"1min":9.9550000000000001,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":35.633000000000003,"5min":351.82100000000003,"15min":585.80600000000004},"last":14.526}]},{"osd":7,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":16.501999999999999,"5min":19.431000000000001,"15min":24.059999999999999},"min":{"1min":10.826000000000001,"5min":7.399,"15min":7.399},"max":{"1min":36.344000000000001,"5min":138.69900000000001,"15min":240.44200000000001},"last":27.715},{"interface":"front","average":{"1min":22.460999999999999,"5min":22.478999999999999,"15min":27.318000000000001},"min":{"1min":13.057,"5min":9.907,"15min":8.1669999999999998},"max":{"1min":49.140999999999998,"5min":138.05699999999999,"15min":342.57799999999997},"last":96.191000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:08.040 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-01T03:41:08.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.145+0000 7f1a7b555640 10 monclient: get_monmap_and_config 2023-11-01T03:41:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.145+0000 7f1a7b555640 10 monclient: build_initial_monmap 2023-11-01T03:41:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.145+0000 7f1a7b555640 10 monclient: monmap: 2023-11-01T03:41:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:08.147637+0000 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:08.147637+0000 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:08.150 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.146+0000 7f1a7b555640 1 Processor -- start 2023-11-01T03:41:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.146+0000 7f1a7b555640 1 -- start start 2023-11-01T03:41:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.146+0000 7f1a7b555640 10 monclient: init 2023-11-01T03:41:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2023-11-01T03:41:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-b con 0x7f1a740a8ae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1a740a8ec0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a740b0de0 0x7f1a7413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-a con 0x7f1a740b0de0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740a9600 con 0x7f1a740a8ec0 2023-11-01T03:41:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740a9360 con 0x7f1a740b0de0 2023-11-01T03:41:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740b80b0 con 0x7f1a740a8ae0 2023-11-01T03:41:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.147+0000 7f1a7b555640 10 monclient(hunting): authenticate will time out at 2744.372114s 2023-11-01T03:41:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.156+0000 7f1a792f1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.156+0000 7f1a79af2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a740b0de0 0x7f1a7413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.159+0000 7f1a78af0640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1a740a8ec0 0x7f1a74145000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50888/0 (socket says 172.21.15.5:50888) 2023-11-01T03:41:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.159+0000 7f1a78af0640 1 -- 172.21.15.5:0/2410317380 learned_addr learned my addr 172.21.15.5:0/2410317380 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.160+0000 7f1a79af2640 10 monclient(hunting): get_auth_request con 0x7f1a740b0de0 auth_method 0 2023-11-01T03:41:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.160+0000 7f1a79af2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.160+0000 7f1a79af2640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.160+0000 7f1a79af2640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.161+0000 7f1a792f1640 10 monclient(hunting): get_auth_request con 0x7f1a740a8ae0 auth_method 0 2023-11-01T03:41:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.161+0000 7f1a792f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.161+0000 7f1a792f1640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.161+0000 7f1a792f1640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.162+0000 7f1a792f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.162+0000 7f1a792f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:08.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.162+0000 7f1a792f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 10 monclient(hunting): handle_auth_done global_id 17342 payload 274 2023-11-01T03:41:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 1 -- 172.21.15.5:0/2410317380 >> v2:172.21.15.5:3300/0 conn(0x7f1a740b0de0 msgr2=0x7f1a7413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 1 --2- 172.21.15.5:0/2410317380 >> v2:172.21.15.5:3300/0 conn(0x7f1a740b0de0 0x7f1a7413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 1 -- 172.21.15.5:0/2410317380 >> v1:172.21.15.153:6789/0 conn(0x7f1a740a8ec0 legacy=0x7f1a74145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 10 monclient: _finish_hunting 0 2023-11-01T03:41:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 1 monclient: found mon.noname-b 2023-11-01T03:41:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.168+0000 7f1a792f1640 1 -- 172.21.15.5:0/2410317380 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74145710 con 0x7f1a740a8ae0 2023-11-01T03:41:08.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.177+0000 7f1a792f1640 1 --2- 172.21.15.5:0/2410317380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7413ec30 secure :-1 s=READY pgs=2891 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009790 tx=0x7f1a7002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5037d0c8bffa8dfc server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 1 -- 172.21.15.5:0/2410317380 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031800 con 0x7f1a740a8ae0 2023-11-01T03:41:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: dump: 2023-11-01T03:41:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:08.200 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: _finish_auth 0 2023-11-01T03:41:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 1 -- 172.21.15.5:0/2410317380 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70031960 con 0x7f1a740a8ae0 2023-11-01T03:41:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a7b555640 5 monclient: authenticate success, global_id 17342 2023-11-01T03:41:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a7b555640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a7b555640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a7b555640 4 set_mon_vals no callback set 2023-11-01T03:41:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 1 -- 172.21.15.5:0/2410317380 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70031cf0 con 0x7f1a740a8ae0 2023-11-01T03:41:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.196+0000 7f1a6bfff640 10 monclient: dump: 2023-11-01T03:41:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:08.205 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 10 monclient: shutdown 2023-11-01T03:41:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 -- 172.21.15.5:0/2410317380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 msgr2=0x7f1a7413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 --2- 172.21.15.5:0/2410317380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7413ec30 secure :-1 s=READY pgs=2891 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009790 tx=0x7f1a7002b8a0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 -- 172.21.15.5:0/2410317380 shutdown_connections 2023-11-01T03:41:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 --2- 172.21.15.5:0/2410317380 >> v2:172.21.15.5:3300/0 conn(0x7f1a740b0de0 0x7f1a7413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 --2- 172.21.15.5:0/2410317380 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7413ec30 unknown :-1 s=CLOSED pgs=2891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 -- 172.21.15.5:0/2410317380 >> 172.21.15.5:0/2410317380 conn(0x7f1a740b7230 msgr2=0x7f1a740b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 -- 172.21.15.5:0/2410317380 shutdown_connections 2023-11-01T03:41:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.197+0000 7f1a7b555640 1 -- 172.21.15.5:0/2410317380 wait complete. 2023-11-01T03:41:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient: build_initial_monmap 2023-11-01T03:41:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient: monmap: 2023-11-01T03:41:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:08.211 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 librados: starting msgr at 2023-11-01T03:41:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 librados: starting objecter 2023-11-01T03:41:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 Processor -- start 2023-11-01T03:41:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 -- start start 2023-11-01T03:41:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 librados: setting wanted keys 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 librados: calling monclient init 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient: init 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7412fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.198+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-c con 0x7f1a740a8ae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-a con 0x7f1a740a8ec0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740b0de0 0x7f1a7412c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): picked mon.noname-b con 0x7f1a740b0de0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741449d0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740b5110 con 0x7f1a740b0de0 2023-11-01T03:41:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740b5280 con 0x7f1a740a8ae0 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.199+0000 7f1a7b555640 10 monclient(hunting): authenticate will time out at 2744.424010s 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.204+0000 7f1a78af0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55556/0 (socket says 172.21.15.5:55556) 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 1 -- 172.21.15.5:0/419897035 learned_addr learned my addr 172.21.15.5:0/419897035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 10 monclient(hunting): get_auth_request con 0x7f1a740a8ec0 auth_method 0 2023-11-01T03:41:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.205+0000 7f1a78af0640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.209+0000 7f1a78af0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.209+0000 7f1a78af0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.209+0000 7f1a78af0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.210+0000 7f1a792f1640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7412fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.213+0000 7f1a792f1640 10 monclient(hunting): get_auth_request con 0x7f1a740a8ae0 auth_method 0 2023-11-01T03:41:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.213+0000 7f1a792f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.213+0000 7f1a792f1640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.213+0000 7f1a792f1640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 10 monclient(hunting): handle_auth_done global_id 15378 payload 824 2023-11-01T03:41:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 -- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 msgr2=0x7f1a7412fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7412fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 -- 172.21.15.5:0/419897035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740b0de0 msgr2=0x7f1a7412c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740b0de0 0x7f1a7412c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 10 monclient: _finish_hunting 0 2023-11-01T03:41:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 monclient: found mon.noname-a 2023-11-01T03:41:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.218+0000 7f1a78af0640 1 -- 172.21.15.5:0/419897035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700093a0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.224+0000 7f1a78af0640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 secure :-1 s=READY pgs=2986 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c500 tx=0x7f1a6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.224+0000 7f1a69ffb640 10 client.?.objecter ms_handle_connect 0x7f1a740a8ec0 2023-11-01T03:41:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.224+0000 7f1a69ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64005ce0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: dump: 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:08.286 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: _finish_auth 0 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64005e40 con 0x7f1a740a8ec0 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 5 monclient: authenticate success, global_id 15378 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 10 monclient: _renew_subs 2023-11-01T03:41:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740b5940 con 0x7f1a740a8ec0 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640072f0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a69ffb640 10 monclient: dump: 2023-11-01T03:41:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:08.289 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a6b7fe640 4 set_mon_vals no callback set 2023-11-01T03:41:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 10 client.15378.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 10 monclient: _renew_subs 2023-11-01T03:41:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a74144420 con 0x7f1a740a8ec0 2023-11-01T03:41:08.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.282+0000 7f1a7b555640 1 librados: init done 2023-11-01T03:41:08.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.283+0000 7f1a7b555640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:08.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.283+0000 7f1a7b555640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:08.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.283+0000 7f1a7b555640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:08.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.283+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a740a9ca0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.535 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.806 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.536 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.808 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.544 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:09.816 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.565+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a64007510 con 0x7f1a740a8ec0 2023-11-01T03:41:08.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.566+0000 7f1a69ffb640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 0x7f1a5806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.566+0000 7f1a792f1640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 0x7f1a5806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.566+0000 7f1a792f1640 10 monclient: get_auth_request con 0x7f1a5806c850 auth_method 0 2023-11-01T03:41:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.566+0000 7f1a792f1640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 0x7f1a5806ed10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036000 tx=0x7f1a7003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.566+0000 7f1a69ffb640 10 client.15378.objecter ms_handle_connect 0x7f1a5806c850 2023-11-01T03:41:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f1a64058170 con 0x7f1a740a8ec0 2023-11-01T03:41:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 10 client.15378.objecter ms_dispatch 0x7f1a74000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 3 client.15378.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 3 client.15378.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:08.600 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.909 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 20 client.15378.objecter dump_active .. 0 homeless 2023-11-01T03:41:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a640544b0 con 0x7f1a740a8ec0 2023-11-01T03:41:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:08.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.598+0000 7f1a69ffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:08.602 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.911 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.614 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:09.924 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.797+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a7414c1c0 con 0x7f1a5806c850 2023-11-01T03:41:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.802+0000 7f1a69ffb640 1 -- 172.21.15.5:0/419897035 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151654 (secure 0 0 0) 0x7f1a70044400 con 0x7f1a5806c850 2023-11-01T03:41:08.805 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 10 librados: watch_flush enter 2023-11-01T03:41:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 10 librados: watch_flush exit 2023-11-01T03:41:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 20 client.15378.objecter shutdown clearing up homeless session... 2023-11-01T03:41:08.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 10 client.15378.objecter successfully canceled tick 2023-11-01T03:41:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 msgr2=0x7f1a5806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 0x7f1a5806ed10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036000 tx=0x7f1a7003c040 comp rx=0 tx=0).stop 2023-11-01T03:41:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 10 monclient: shutdown 2023-11-01T03:41:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:08.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 msgr2=0x7f1a7412c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 secure :-1 s=READY pgs=2986 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c500 tx=0x7f1a6400c9c0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 shutdown_connections 2023-11-01T03:41:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1a5806c850 0x7f1a5806ed10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740b0de0 0x7f1a7412c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a740a8ec0 0x7f1a7412c490 unknown :-1 s=CLOSED pgs=2986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 --2- 172.21.15.5:0/419897035 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1a740a8ae0 0x7f1a7412fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 >> 172.21.15.5:0/419897035 conn(0x7f1a740b7230 msgr2=0x7f1a74136d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 shutdown_connections 2023-11-01T03:41:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 -- 172.21.15.5:0/419897035 wait complete. 2023-11-01T03:41:08.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.805+0000 7f1a7b555640 1 librados: shutdown 2023-11-01T03:41:08.818 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1571,"stamp":"2023-11-01T03:41:07.509205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":554844,"kb_used_data":43028,"kb_used_omap":12,"kb_used_meta":511667,"kb_avail":754419876,"statfs":{"total":773094113280,"available":772525953024,"internally_reserved":0,"allocated":44060672,"data_stored":23814127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":523947577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":367,"apply_latency_ms":367,"commit_latency_ns":367000000,"apply_latency_ns":367000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.696192"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.734551+0000","last_change":"2023-11-01T03:20:28.999446+0000","last_active":"2023-11-01T03:41:00.734551+0000","last_peered":"2023-11-01T03:41:00.734551+0000","last_clean":"2023-11-01T03:41:00.734551+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:00.734551+0000","last_undegraded":"2023-11-01T03:41:00.734551+0000","last_fullsized":"2023-11-01T03:41:00.734551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:52:15.750885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.526486+0000","last_change":"2023-11-01T03:20:21.292351+0000","last_active":"2023-11-01T03:41:00.526486+0000","last_peered":"2023-11-01T03:41:00.526486+0000","last_clean":"2023-11-01T03:41:00.526486+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:00.526486+0000","last_undegraded":"2023-11-01T03:41:00.526486+0000","last_fullsized":"2023-11-01T03:41:00.526486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:45.398675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":849,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.708361+0000","last_change":"2023-11-01T03:20:24.849514+0000","last_active":"2023-11-01T03:41:01.708361+0000","last_peered":"2023-11-01T03:41:01.708361+0000","last_clean":"2023-11-01T03:41:01.708361+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:01.708361+0000","last_undegraded":"2023-11-01T03:41:01.708361+0000","last_fullsized":"2023-11-01T03:41:01.708361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:42.030216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.778198+0000","last_change":"2023-11-01T03:20:28.961484+0000","last_active":"2023-11-01T03:41:01.778198+0000","last_peered":"2023-11-01T03:41:01.778198+0000","last_clean":"2023-11-01T03:41:01.778198+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:01.778198+0000","last_undegraded":"2023-11-01T03:41:01.778198+0000","last_fullsized":"2023-11-01T03:41:01.778198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:57:14.344671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":853,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.692508+0000","last_change":"2023-11-01T03:20:14.753917+0000","last_active":"2023-11-01T03:41:00.692508+0000","last_peered":"2023-11-01T03:41:00.692508+0000","last_clean":"2023-11-01T03:41:00.692508+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:00.692508+0000","last_undegraded":"2023-11-01T03:41:00.692508+0000","last_fullsized":"2023-11-01T03:41:00.692508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:16:48.817140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":852,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.101313+0000","last_change":"2023-11-01T03:20:19.035194+0000","last_active":"2023-11-01T03:41:05.101313+0000","last_peered":"2023-11-01T03:41:05.101313+0000","last_clean":"2023-11-01T03:41:05.101313+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:05.101313+0000","last_undegraded":"2023-11-01T03:41:05.101313+0000","last_fullsized":"2023-11-01T03:41:05.101313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:36:18.123385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.675805+0000","last_change":"2023-11-01T03:21:04.928879+0000","last_active":"2023-11-01T03:41:01.675805+0000","last_peered":"2023-11-01T03:41:01.675805+0000","last_clean":"2023-11-01T03:41:01.675805+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:01.675805+0000","last_undegraded":"2023-11-01T03:41:01.675805+0000","last_fullsized":"2023-11-01T03:41:01.675805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:59:54.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":852,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.117205+0000","last_change":"2023-11-01T03:20:17.044459+0000","last_active":"2023-11-01T03:41:05.117205+0000","last_peered":"2023-11-01T03:41:05.117205+0000","last_clean":"2023-11-01T03:41:05.117205+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:05.117205+0000","last_undegraded":"2023-11-01T03:41:05.117205+0000","last_fullsized":"2023-11-01T03:41:05.117205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:12:42.352566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.947434+0000","last_change":"2023-11-01T03:20:21.310132+0000","last_active":"2023-11-01T03:41:02.947434+0000","last_peered":"2023-11-01T03:41:02.947434+0000","last_clean":"2023-11-01T03:41:02.947434+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:02.947434+0000","last_undegraded":"2023-11-01T03:41:02.947434+0000","last_fullsized":"2023-11-01T03:41:02.947434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:50:11.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.528113+0000","last_change":"2023-11-01T03:20:21.284659+0000","last_active":"2023-11-01T03:41:00.528113+0000","last_peered":"2023-11-01T03:41:00.528113+0000","last_clean":"2023-11-01T03:41:00.528113+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:00.528113+0000","last_undegraded":"2023-11-01T03:41:00.528113+0000","last_fullsized":"2023-11-01T03:41:00.528113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:27:21.187272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.986156+0000","last_change":"2023-11-01T03:20:24.027089+0000","last_active":"2023-11-01T03:41:02.986156+0000","last_peered":"2023-11-01T03:41:02.986156+0000","last_clean":"2023-11-01T03:41:02.986156+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:02.986156+0000","last_undegraded":"2023-11-01T03:41:02.986156+0000","last_fullsized":"2023-11-01T03:41:02.986156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:29:01.442024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":868,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.999907+0000","last_change":"2023-11-01T03:20:25.928340+0000","last_active":"2023-11-01T03:41:02.999907+0000","last_peered":"2023-11-01T03:41:02.999907+0000","last_clean":"2023-11-01T03:41:02.999907+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:02.999907+0000","last_undegraded":"2023-11-01T03:41:02.999907+0000","last_fullsized":"2023-11-01T03:41:02.999907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:44:04.520733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.570862+0000","last_change":"2023-11-01T03:20:21.132613+0000","last_active":"2023-11-01T03:41:01.570862+0000","last_peered":"2023-11-01T03:41:01.570862+0000","last_clean":"2023-11-01T03:41:01.570862+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:01.570862+0000","last_undegraded":"2023-11-01T03:41:01.570862+0000","last_fullsized":"2023-11-01T03:41:01.570862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:14:39.509557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.746532+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:41:00.746532+0000","last_peered":"2023-11-01T03:41:00.746532+0000","last_clean":"2023-11-01T03:41:00.746532+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:00.746532+0000","last_undegraded":"2023-11-01T03:41:00.746532+0000","last_fullsized":"2023-11-01T03:41:00.746532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":854,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.736259+0000","last_change":"2023-11-01T03:20:20.628315+0000","last_active":"2023-11-01T03:41:00.736259+0000","last_peered":"2023-11-01T03:41:00.736259+0000","last_clean":"2023-11-01T03:41:00.736259+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:00.736259+0000","last_undegraded":"2023-11-01T03:41:00.736259+0000","last_fullsized":"2023-11-01T03:41:00.736259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:13:44.355143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":858,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.093560+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:41:05.093560+0000","last_peered":"2023-11-01T03:41:05.093560+0000","last_clean":"2023-11-01T03:41:05.093560+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:05.093560+0000","last_undegraded":"2023-11-01T03:41:05.093560+0000","last_fullsized":"2023-11-01T03:41:05.093560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:05:15.577920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.715332+0000","last_change":"2023-11-01T03:20:22.257051+0000","last_active":"2023-11-01T03:41:01.715332+0000","last_peered":"2023-11-01T03:41:01.715332+0000","last_clean":"2023-11-01T03:41:01.715332+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:01.715332+0000","last_undegraded":"2023-11-01T03:41:01.715332+0000","last_fullsized":"2023-11-01T03:41:01.715332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:59:19.002962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.738593+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:41:00.738593+0000","last_peered":"2023-11-01T03:41:00.738593+0000","last_clean":"2023-11-01T03:41:00.738593+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:00.738593+0000","last_undegraded":"2023-11-01T03:41:00.738593+0000","last_fullsized":"2023-11-01T03:41:00.738593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.740155+0000","last_change":"2023-11-01T03:20:24.831827+0000","last_active":"2023-11-01T03:41:01.740155+0000","last_peered":"2023-11-01T03:41:01.740155+0000","last_clean":"2023-11-01T03:41:01.740155+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:01.740155+0000","last_undegraded":"2023-11-01T03:41:01.740155+0000","last_fullsized":"2023-11-01T03:41:01.740155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:48:19.626083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":867,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.529764+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:41:00.529764+0000","last_peered":"2023-11-01T03:41:00.529764+0000","last_clean":"2023-11-01T03:41:00.529764+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:00.529764+0000","last_undegraded":"2023-11-01T03:41:00.529764+0000","last_fullsized":"2023-11-01T03:41:00.529764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.509242+0000","last_change":"2023-11-01T03:20:38.569214+0000","last_active":"2023-11-01T03:41:00.509242+0000","last_peered":"2023-11-01T03:41:00.509242+0000","last_clean":"2023-11-01T03:41:00.509242+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:00.509242+0000","last_undegraded":"2023-11-01T03:41:00.509242+0000","last_fullsized":"2023-11-01T03:41:00.509242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:01:54.979113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.712229+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:41:00.712229+0000","last_peered":"2023-11-01T03:41:00.712229+0000","last_clean":"2023-11-01T03:41:00.712229+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:00.712229+0000","last_undegraded":"2023-11-01T03:41:00.712229+0000","last_fullsized":"2023-11-01T03:41:00.712229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":853,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.114079+0000","last_change":"2023-11-01T03:20:28.854647+0000","last_active":"2023-11-01T03:41:05.114079+0000","last_peered":"2023-11-01T03:41:05.114079+0000","last_clean":"2023-11-01T03:41:05.114079+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:05.114079+0000","last_undegraded":"2023-11-01T03:41:05.114079+0000","last_fullsized":"2023-11-01T03:41:05.114079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:21:38.217969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":856,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.578031+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:41:01.578031+0000","last_peered":"2023-11-01T03:41:01.578031+0000","last_clean":"2023-11-01T03:41:01.578031+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:01.578031+0000","last_undegraded":"2023-11-01T03:41:01.578031+0000","last_fullsized":"2023-11-01T03:41:01.578031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.518598+0000","last_change":"2023-11-01T03:20:27.836705+0000","last_active":"2023-11-01T03:41:00.518598+0000","last_peered":"2023-11-01T03:41:00.518598+0000","last_clean":"2023-11-01T03:41:00.518598+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:00.518598+0000","last_undegraded":"2023-11-01T03:41:00.518598+0000","last_fullsized":"2023-11-01T03:41:00.518598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:24:51.036742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.668334+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:41:00.668334+0000","last_peered":"2023-11-01T03:41:00.668334+0000","last_clean":"2023-11-01T03:41:00.668334+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:00.668334+0000","last_undegraded":"2023-11-01T03:41:00.668334+0000","last_fullsized":"2023-11-01T03:41:00.668334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.501088+0000","last_change":"2023-11-01T03:20:25.561602+0000","last_active":"2023-11-01T03:41:00.501088+0000","last_peered":"2023-11-01T03:41:00.501088+0000","last_clean":"2023-11-01T03:41:00.501088+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:00.501088+0000","last_undegraded":"2023-11-01T03:41:00.501088+0000","last_fullsized":"2023-11-01T03:41:00.501088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:09:15.818152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":859,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.724979+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:41:00.724979+0000","last_peered":"2023-11-01T03:41:00.724979+0000","last_clean":"2023-11-01T03:41:00.724979+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:00.724979+0000","last_undegraded":"2023-11-01T03:41:00.724979+0000","last_fullsized":"2023-11-01T03:41:00.724979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"21'76","reported_seq":964,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.104516+0000","last_change":"2023-11-01T03:19:01.879653+0000","last_active":"2023-11-01T03:41:05.104516+0000","last_peered":"2023-11-01T03:41:05.104516+0000","last_clean":"2023-11-01T03:41:05.104516+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:05.104516+0000","last_undegraded":"2023-11-01T03:41:05.104516+0000","last_fullsized":"2023-11-01T03:41:05.104516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:18:57.938958+0000","last_clean_scrub_stamp":"2023-11-01T03:18:57.938958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:10:19.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":868,"reported_epoch":900,"state":"active+clean","last_fresh":"2023-11-01T03:41:04.319158+0000","last_change":"2023-11-01T03:20:23.770784+0000","last_active":"2023-11-01T03:41:04.319158+0000","last_peered":"2023-11-01T03:41:04.319158+0000","last_clean":"2023-11-01T03:41:04.319158+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:04.319158+0000","last_undegraded":"2023-11-01T03:41:04.319158+0000","last_fullsized":"2023-11-01T03:41:04.319158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:52:35.620928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.711889+0000","last_change":"2023-11-01T03:20:16.655844+0000","last_active":"2023-11-01T03:41:01.711889+0000","last_peered":"2023-11-01T03:41:01.711889+0000","last_clean":"2023-11-01T03:41:01.711889+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:01.711889+0000","last_undegraded":"2023-11-01T03:41:01.711889+0000","last_fullsized":"2023-11-01T03:41:01.711889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:09:46.488826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":863,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.504037+0000","last_change":"2023-11-01T03:20:27.628859+0000","last_active":"2023-11-01T03:41:00.504037+0000","last_peered":"2023-11-01T03:41:00.504037+0000","last_clean":"2023-11-01T03:41:00.504037+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:00.504037+0000","last_undegraded":"2023-11-01T03:41:00.504037+0000","last_fullsized":"2023-11-01T03:41:00.504037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:50:18.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"39'7","reported_seq":865,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:03.328908+0000","last_change":"2023-11-01T03:20:16.772503+0000","last_active":"2023-11-01T03:41:03.328908+0000","last_peered":"2023-11-01T03:41:03.328908+0000","last_clean":"2023-11-01T03:41:03.328908+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:03.328908+0000","last_undegraded":"2023-11-01T03:41:03.328908+0000","last_fullsized":"2023-11-01T03:41:03.328908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:41:51.271420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":852,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.717542+0000","last_change":"2023-11-01T03:20:20.690944+0000","last_active":"2023-11-01T03:41:01.717542+0000","last_peered":"2023-11-01T03:41:01.717542+0000","last_clean":"2023-11-01T03:41:01.717542+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:01.717542+0000","last_undegraded":"2023-11-01T03:41:01.717542+0000","last_fullsized":"2023-11-01T03:41:01.717542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:55:05.740678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":850,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.741885+0000","last_change":"2023-11-01T03:20:31.376540+0000","last_active":"2023-11-01T03:41:01.741885+0000","last_peered":"2023-11-01T03:41:01.741885+0000","last_clean":"2023-11-01T03:41:01.741885+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:01.741885+0000","last_undegraded":"2023-11-01T03:41:01.741885+0000","last_fullsized":"2023-11-01T03:41:01.741885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:48:22.668122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.572774+0000","last_change":"2023-11-01T03:20:15.800818+0000","last_active":"2023-11-01T03:41:01.572774+0000","last_peered":"2023-11-01T03:41:01.572774+0000","last_clean":"2023-11-01T03:41:01.572774+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:01.572774+0000","last_undegraded":"2023-11-01T03:41:01.572774+0000","last_fullsized":"2023-11-01T03:41:01.572774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:20:00.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":862,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.533702+0000","last_change":"2023-11-01T03:20:38.737137+0000","last_active":"2023-11-01T03:41:00.533702+0000","last_peered":"2023-11-01T03:41:00.533702+0000","last_clean":"2023-11-01T03:41:00.533702+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:00.533702+0000","last_undegraded":"2023-11-01T03:41:00.533702+0000","last_fullsized":"2023-11-01T03:41:00.533702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:57:06.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":861,"reported_epoch":897,"state":"active+clean","last_fresh":"2023-11-01T03:41:00.510928+0000","last_change":"2023-11-01T03:20:21.863000+0000","last_active":"2023-11-01T03:41:00.510928+0000","last_peered":"2023-11-01T03:41:00.510928+0000","last_clean":"2023-11-01T03:41:00.510928+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:00.510928+0000","last_undegraded":"2023-11-01T03:41:00.510928+0000","last_fullsized":"2023-11-01T03:41:00.510928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:08:06.676287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":853,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.104747+0000","last_change":"2023-11-01T03:20:21.943627+0000","last_active":"2023-11-01T03:41:05.104747+0000","last_peered":"2023-11-01T03:41:05.104747+0000","last_clean":"2023-11-01T03:41:05.104747+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:05.104747+0000","last_undegraded":"2023-11-01T03:41:05.104747+0000","last_fullsized":"2023-11-01T03:41:05.104747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:31:18.289912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":851,"reported_epoch":898,"state":"active+clean","last_fresh":"2023-11-01T03:41:01.661847+0000","last_change":"2023-11-01T03:20:31.359278+0000","last_active":"2023-11-01T03:41:01.661847+0000","last_peered":"2023-11-01T03:41:01.661847+0000","last_clean":"2023-11-01T03:41:01.661847+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:01.661847+0000","last_undegraded":"2023-11-01T03:41:01.661847+0000","last_fullsized":"2023-11-01T03:41:01.661847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:03:02.004192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":866,"reported_epoch":899,"state":"active+clean","last_fresh":"2023-11-01T03:41:02.886975+0000","last_change":"2023-11-01T03:20:20.196742+0000","last_active":"2023-11-01T03:41:02.886975+0000","last_peered":"2023-11-01T03:41:02.886975+0000","last_clean":"2023-11-01T03:41:02.886975+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:02.886975+0000","last_undegraded":"2023-11-01T03:41:02.886975+0000","last_fullsized":"2023-11-01T03:41:02.886975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:20:43.175812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58612,"kb_used_data":5224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313228,"statfs":{"total":96636764160,"available":96576745472,"internally_reserved":0,"allocated":5349376,"data_stored":2829167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":9.9390000000000001},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":11.432}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":10.82},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":24.141999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":31.701000000000001},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":22.506}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":7.7329999999999997},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":20.841999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":23.494},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":18.329000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":26.986000000000001},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":30.585999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":36.545000000000002},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":25.515999999999998}]}]},{"osd":1,"up_from":16,"seq":68719477002,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81276,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290564,"statfs":{"total":96636764160,"available":96553537536,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":26.581,"5min":15.032,"15min":17.754000000000001},"min":{"1min":6.7830000000000004,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":202.77600000000001,"5min":202.77600000000001,"15min":233.18799999999999},"last":7.0890000000000004},{"interface":"front","average":{"1min":25.585000000000001,"5min":17.437000000000001,"15min":20.001000000000001},"min":{"1min":8.0950000000000006,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":211.577,"5min":211.577,"15min":227.72900000000001},"last":17.59}]},{"osd":2,"last update":"Wed Nov 1 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":15.635,"5min":19.303000000000001,"15min":23.484999999999999},"min":{"1min":7.8239999999999998,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":62.979999999999997,"5min":157.964,"15min":226.35300000000001},"last":14.762},{"interface":"front","average":{"1min":16.472000000000001,"5min":21.312000000000001,"15min":22.969000000000001},"min":{"1min":8.7490000000000006,"5min":7.649,"15min":6.7699999999999996},"max":{"1min":44.670999999999999,"5min":230.01499999999999,"15min":230.01499999999999},"last":10.039}]},{"osd":3,"last update":"Wed Nov 1 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":22.356000000000002,"5min":19.739999999999998,"15min":26.463000000000001},"min":{"1min":9.2609999999999992,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":139.18199999999999,"5min":139.18199999999999,"15min":301.214},"last":12.221},{"interface":"front","average":{"1min":20.103999999999999,"5min":16.913,"15min":23.349},"min":{"1min":7.2690000000000001,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":158.572,"5min":167.44900000000001,"15min":289.25400000000002},"last":7.9770000000000003}]},{"osd":4,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":25.346,"5min":19.154,"15min":21.763999999999999},"min":{"1min":6.8310000000000004,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":92.372,"5min":92.372,"15min":228.119},"last":16.934999999999999},{"interface":"front","average":{"1min":21.606000000000002,"5min":17.113,"15min":22.614999999999998},"min":{"1min":6.8810000000000002,"5min":6.7969999999999997,"15min":6.7969999999999997},"max":{"1min":82.914000000000001,"5min":82.914000000000001,"15min":265.774},"last":11.425000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":20.431999999999999,"5min":21.949999999999999,"15min":26.109999999999999},"min":{"1min":7.234,"5min":7.234,"15min":7.234},"max":{"1min":47.537999999999997,"5min":104.411,"15min":277.53100000000001},"last":21.442},{"interface":"front","average":{"1min":18.678999999999998,"5min":21.218,"15min":25.378},"min":{"1min":7.9809999999999999,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":86.488,"5min":107.372,"15min":270.26400000000001},"last":23.841999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.664999999999999,"5min":22.835999999999999,"15min":26.817},"min":{"1min":10.542999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":55.893000000000001,"5min":111.179,"15min":240.887},"last":12.923},{"interface":"front","average":{"1min":22.527999999999999,"5min":26.219999999999999,"15min":29.495999999999999},"min":{"1min":14.475,"5min":13.331,"15min":10.785},"max":{"1min":59.003999999999998,"5min":144.75399999999999,"15min":271.04899999999998},"last":20.157}]},{"osd":7,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.878,"5min":17.433,"15min":26.861000000000001},"min":{"1min":9.0549999999999997,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":88.796000000000006,"5min":88.796000000000006,"15min":348.608},"last":19.803000000000001},{"interface":"front","average":{"1min":24.318999999999999,"5min":24.468,"15min":31.408000000000001},"min":{"1min":15.694000000000001,"5min":12.734999999999999,"15min":11.98},"max":{"1min":89.978999999999999,"5min":104.134,"15min":345.22899999999998},"last":13.52}]}]},{"osd":3,"up_from":16,"seq":68719477001,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76716,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295124,"statfs":{"total":96636764160,"available":96558206976,"internally_reserved":0,"allocated":5398528,"data_stored":2878319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":11.449},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":10.776999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":7.9649999999999999},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":8.4559999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":13.223000000000001},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":8.8819999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":12.593999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":13.981}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":18.126999999999999},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":16.663}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":14.612},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":15.348000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":15.976000000000001},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":17.323}]}]},{"osd":0,"up_from":16,"seq":68719477002,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62852,"kb_used_data":5300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308988,"statfs":{"total":96636764160,"available":96572403712,"internally_reserved":0,"allocated":5427200,"data_stored":2898189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":15.183,"5min":13.965999999999999,"15min":20.741},"min":{"1min":8.4350000000000005,"5min":6.2430000000000003,"15min":5.0919999999999996},"max":{"1min":29.344000000000001,"5min":63.280000000000001,"15min":193.87200000000001},"last":8.9359999999999999},{"interface":"front","average":{"1min":13.127000000000001,"5min":13.782,"15min":19.478999999999999},"min":{"1min":6.4610000000000003,"5min":6.0229999999999997,"15min":6.0179999999999998},"max":{"1min":41.377000000000002,"5min":61.674999999999997,"15min":208.66800000000001},"last":9.7989999999999995}]},{"osd":2,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.792000000000002,"5min":17.826000000000001,"15min":24.395},"min":{"1min":9.9939999999999998,"5min":8.1379999999999999,"15min":6.657},"max":{"1min":31.626000000000001,"5min":93.488,"15min":238.64400000000001},"last":12.885},{"interface":"front","average":{"1min":16.863,"5min":16.988,"15min":21.623000000000001},"min":{"1min":7.1680000000000001,"5min":6.8760000000000003,"15min":6.2300000000000004},"max":{"1min":50.618000000000002,"5min":102.666,"15min":272.35500000000002},"last":12.161}]},{"osd":3,"last update":"Wed Nov 1 03:40:51 2023","interfaces":[{"interface":"back","average":{"1min":16.027999999999999,"5min":15.141999999999999,"15min":25.698},"min":{"1min":7.6429999999999998,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":67.299999999999997,"5min":67.299999999999997,"15min":285.99099999999999},"last":10.35},{"interface":"front","average":{"1min":22.164000000000001,"5min":21.707000000000001,"15min":27.375},"min":{"1min":10.720000000000001,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":66.314999999999998,"5min":216.52000000000001,"15min":334.51100000000002},"last":13.898999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.289999999999999,"5min":20.956,"15min":24.43},"min":{"1min":11.702,"5min":7.5789999999999997,"15min":7.5789999999999997},"max":{"1min":38.886000000000003,"5min":206.935,"15min":206.935},"last":17.504999999999999},{"interface":"front","average":{"1min":18.594999999999999,"5min":18.873999999999999,"15min":25.129999999999999},"min":{"1min":11.151,"5min":6.867,"15min":6.867},"max":{"1min":51.771999999999998,"5min":143.786,"15min":259.03399999999999},"last":8.2409999999999997}]},{"osd":5,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.010999999999999,"5min":21.155000000000001,"15min":22.881},"min":{"1min":6.7779999999999996,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.651000000000003,"5min":178.88300000000001,"15min":225.07300000000001},"last":11.311999999999999},{"interface":"front","average":{"1min":22.504000000000001,"5min":25.228999999999999,"15min":26.687999999999999},"min":{"1min":13.220000000000001,"5min":11.926,"15min":8.423},"max":{"1min":50.25,"5min":178.24199999999999,"15min":198.66900000000001},"last":14.567}]},{"osd":6,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":20.844000000000001,"15min":28.954999999999998},"min":{"1min":9.218,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":53.276000000000003,"5min":177.26900000000001,"15min":450.18599999999998},"last":16.591999999999999},{"interface":"front","average":{"1min":24.831,"5min":24.460000000000001,"15min":31.073},"min":{"1min":15.340999999999999,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":51.051000000000002,"5min":91.165999999999997,"15min":282.93000000000001},"last":19.184999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":22.015000000000001,"5min":23.861999999999998,"15min":27.366},"min":{"1min":9.5079999999999991,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":52.453000000000003,"5min":144.767,"15min":230.99600000000001},"last":15.206},{"interface":"front","average":{"1min":24.102,"5min":25.707999999999998,"15min":30.646000000000001},"min":{"1min":10.026999999999999,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":45.552,"5min":148.28200000000001,"15min":226.959},"last":18.347999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509707,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77100,"kb_used_data":5656,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294740,"statfs":{"total":96636764160,"available":96557813760,"internally_reserved":0,"allocated":5791744,"data_stored":3267967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":10.679,"5min":14.500999999999999,"15min":18.439},"min":{"1min":4.9640000000000004,"5min":4.444,"15min":4.444},"max":{"1min":20.597999999999999,"5min":70.945999999999998,"15min":231.386},"last":91.474999999999994},{"interface":"front","average":{"1min":10.138,"5min":16.434999999999999,"15min":21.382999999999999},"min":{"1min":5.0300000000000002,"5min":4.5090000000000003,"15min":4.5090000000000003},"max":{"1min":18.754999999999999,"5min":111.236,"15min":229.50299999999999},"last":49.658000000000001}]},{"osd":1,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.744999999999999,"5min":20.986999999999998,"15min":23.802},"min":{"1min":6.3540000000000001,"5min":6.0179999999999998,"15min":5.3780000000000001},"max":{"1min":58.527999999999999,"5min":302.94099999999997,"15min":328.08199999999999},"last":120.39},{"interface":"front","average":{"1min":18.532,"5min":27.169,"15min":31.489000000000001},"min":{"1min":8.2050000000000001,"5min":7.6340000000000003,"15min":7.6340000000000003},"max":{"1min":60.542999999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":124.95399999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":15.901,"5min":22.568000000000001,"15min":23.664999999999999},"min":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":34.584000000000003,"5min":195.53700000000001,"15min":195.53700000000001},"last":45.817999999999998},{"interface":"front","average":{"1min":13.531000000000001,"5min":22.632000000000001,"15min":22.719000000000001},"min":{"1min":6.4530000000000003,"5min":6.4109999999999996,"15min":6.0259999999999998},"max":{"1min":20.637,"5min":252.57900000000001,"15min":252.57900000000001},"last":44.540999999999997}]},{"osd":3,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":15.587,"5min":25.533000000000001,"15min":30.013000000000002},"min":{"1min":9.452,"5min":6.383,"15min":6.383},"max":{"1min":22.768000000000001,"5min":226.05600000000001,"15min":726.51099999999997},"last":53.186},{"interface":"front","average":{"1min":15.470000000000001,"5min":26.940000000000001,"15min":31.023},"min":{"1min":10.199,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":25.969999999999999,"5min":186.75999999999999,"15min":784.01700000000005},"last":37.101999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.624000000000001,"5min":24.079999999999998,"15min":27.091999999999999},"min":{"1min":7.2830000000000004,"5min":7.2530000000000001,"15min":6.8979999999999997},"max":{"1min":28.57,"5min":158.505,"15min":327.47699999999998},"last":121.00700000000001},{"interface":"front","average":{"1min":17.361999999999998,"5min":27.986999999999998,"15min":30.132000000000001},"min":{"1min":9.1989999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":29.838000000000001,"5min":205.315,"15min":315.95100000000002},"last":38.863}]},{"osd":6,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":16.306999999999999,"5min":27.713999999999999,"15min":28.725000000000001},"min":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":29.844999999999999,"5min":171.857,"15min":249.559},"last":94.876000000000005},{"interface":"front","average":{"1min":14.456,"5min":27.353999999999999,"15min":31.786999999999999},"min":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":24.298999999999999,"5min":182.077,"15min":383.42099999999999},"last":133.702}]},{"osd":7,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":17.582000000000001,"5min":25.562000000000001,"15min":28.114999999999998},"min":{"1min":11.412000000000001,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":32.265999999999998,"5min":170.60599999999999,"15min":215.22399999999999},"last":42.237000000000002},{"interface":"front","average":{"1min":17.917000000000002,"5min":24.146000000000001,"15min":27.420000000000002},"min":{"1min":11.912000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":30.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":48.853000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542411,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5398528,"data_stored":2874228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":22.065000000000001,"5min":24.597999999999999,"15min":21.370999999999999},"min":{"1min":5.3769999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":132.393,"5min":205.869,"15min":205.869},"last":11.029},{"interface":"front","average":{"1min":23.149999999999999,"5min":28.571999999999999,"15min":25.462},"min":{"1min":10.762,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":146.113,"5min":248.73099999999999,"15min":248.73099999999999},"last":16.672999999999998}]},{"osd":1,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":12.084,"5min":21.053999999999998,"15min":23.530000000000001},"min":{"1min":6.6020000000000003,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":61.753,"5min":272.86900000000003,"15min":272.86900000000003},"last":7.4829999999999997},{"interface":"front","average":{"1min":28.754999999999999,"5min":28.062000000000001,"15min":28.823},"min":{"1min":9.8300000000000001,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":267.911,"5min":267.911,"15min":352.642},"last":14.414}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":17.931000000000001,"5min":24.111999999999998,"15min":24.303999999999998},"min":{"1min":8.8209999999999997,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":62.329000000000001,"5min":153.25399999999999,"15min":167.721},"last":15.112},{"interface":"front","average":{"1min":17.760999999999999,"5min":20.530999999999999,"15min":22.216000000000001},"min":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":71.908000000000001,"5min":156.71199999999999,"15min":317.15300000000002},"last":9.8070000000000004}]},{"osd":3,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":19.149999999999999,"5min":28.553999999999998,"15min":28.556000000000001},"min":{"1min":9.6020000000000003,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":66.546000000000006,"5min":207.48699999999999,"15min":864.23099999999999},"last":12.93},{"interface":"front","average":{"1min":25.015999999999998,"5min":25.204000000000001,"15min":21.548999999999999},"min":{"1min":6.2699999999999996,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":136.334,"5min":210.626,"15min":263.649},"last":9.0640000000000001}]},{"osd":4,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.088000000000001,"5min":27.611000000000001,"15min":24.763000000000002},"min":{"1min":11.535,"5min":7.6989999999999998,"15min":7.2000000000000002},"max":{"1min":89.551000000000002,"5min":159.137,"15min":168.39099999999999},"last":18.556000000000001},{"interface":"front","average":{"1min":16.887,"5min":23.902999999999999,"15min":21.550000000000001},"min":{"1min":9.5350000000000001,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":81.560000000000002,"5min":160.304,"15min":160.304},"last":12.242000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.786999999999999,"5min":27.809999999999999,"15min":23.050000000000001},"min":{"1min":11.93,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":80.522999999999996,"5min":155.24299999999999,"15min":270.94600000000003},"last":17.510000000000002},{"interface":"front","average":{"1min":18.129000000000001,"5min":25.039000000000001,"15min":26.381},"min":{"1min":10.413,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":65.290999999999997,"5min":153.74199999999999,"15min":272.613},"last":13.592000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":14.641999999999999,"5min":18.841000000000001,"15min":20.309000000000001},"min":{"1min":6.798,"5min":6.3719999999999999,"15min":5.9080000000000004},"max":{"1min":99.433000000000007,"5min":153.58699999999999,"15min":204.26400000000001},"last":28.861999999999998},{"interface":"front","average":{"1min":22.571999999999999,"5min":28.119,"15min":29.311},"min":{"1min":11.381,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":94.052999999999997,"5min":176.62899999999999,"15min":187.38900000000001},"last":19.486000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575116,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80956,"kb_used_data":5360,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290884,"statfs":{"total":96636764160,"available":96553865216,"internally_reserved":0,"allocated":5488640,"data_stored":2959629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":14.619,"5min":18.068999999999999,"15min":17.006},"min":{"1min":4.7889999999999997,"5min":4.4829999999999997,"15min":4.431},"max":{"1min":74.355000000000004,"5min":182.16200000000001,"15min":215.01400000000001},"last":6.7119999999999997},{"interface":"front","average":{"1min":15.571999999999999,"5min":18.236999999999998,"15min":17.800999999999998},"min":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":70.613,"5min":165.08500000000001,"15min":208.00800000000001},"last":11.363}]},{"osd":1,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":18.352,"5min":26.658000000000001,"15min":23.210000000000001},"min":{"1min":5.6749999999999998,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":120.19799999999999,"5min":508.113,"15min":508.113},"last":10.365},{"interface":"front","average":{"1min":14.755000000000001,"5min":21.356999999999999,"15min":19.134},"min":{"1min":6.5369999999999999,"5min":6.4210000000000003,"15min":5.1879999999999997},"max":{"1min":52.587000000000003,"5min":183.512,"15min":183.512},"last":12.666}]},{"osd":2,"last update":"Wed Nov 1 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":23.193000000000001,"5min":26.809999999999999,"15min":22.952000000000002},"min":{"1min":7.0270000000000001,"5min":6.9059999999999997,"15min":6.3600000000000003},"max":{"1min":105.779,"5min":276.858,"15min":276.858},"last":122.467},{"interface":"front","average":{"1min":32.453000000000003,"5min":31.931999999999999,"15min":24.888999999999999},"min":{"1min":7.9779999999999998,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":252.52099999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":149.95599999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":20.033000000000001,"5min":21.949999999999999,"15min":26.713000000000001},"min":{"1min":8.0079999999999991,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":66.866,"5min":77.144000000000005,"15min":327.39800000000002},"last":14.878},{"interface":"front","average":{"1min":23.605,"5min":27.524000000000001,"15min":29.152000000000001},"min":{"1min":7.7480000000000002,"5min":7.2220000000000004,"15min":6.8659999999999997},"max":{"1min":95.472999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":13.461}]},{"osd":4,"last update":"Wed Nov 1 03:40:34 2023","interfaces":[{"interface":"back","average":{"1min":17.314,"5min":19.512,"15min":19.417999999999999},"min":{"1min":8.7159999999999993,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":59.195999999999998,"5min":125.809,"15min":303.637},"last":8.5609999999999999},{"interface":"front","average":{"1min":21.106000000000002,"5min":25.699000000000002,"15min":25.07},"min":{"1min":10.291,"5min":9.1750000000000007,"15min":7.4169999999999998},"max":{"1min":67.885999999999996,"5min":188.06700000000001,"15min":304.79700000000003},"last":14.147}]},{"osd":5,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":19.776,"5min":25.221,"15min":22.968},"min":{"1min":9.952,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":68.028000000000006,"5min":125.69,"15min":143.779},"last":15.500999999999999},{"interface":"front","average":{"1min":21.169,"5min":32.682000000000002,"15min":27.797000000000001},"min":{"1min":10.411,"5min":9.5719999999999992,"15min":8.4670000000000005},"max":{"1min":71.522999999999996,"5min":530.04300000000001,"15min":530.04300000000001},"last":19.120000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":22.713999999999999,"5min":31.914999999999999,"15min":26.495000000000001},"min":{"1min":12.776,"5min":8.2309999999999999,"15min":7.4710000000000001},"max":{"1min":69.022000000000006,"5min":319.23700000000002,"15min":319.23700000000002},"last":17.265999999999998},{"interface":"front","average":{"1min":21.402000000000001,"5min":29.286000000000001,"15min":24.658000000000001},"min":{"1min":10.721,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":57.826999999999998,"5min":193.06299999999999,"15min":193.06299999999999},"last":18.465}]}]},{"osd":4,"up_from":13,"seq":55834575116,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58664,"kb_used_data":5272,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313176,"statfs":{"total":96636764160,"available":96576692224,"internally_reserved":0,"allocated":5398528,"data_stored":2850715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.542000000000002,"5min":14.725,"15min":17.497},"min":{"1min":4.8440000000000003,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":98.876000000000005,"5min":101.489,"15min":218.07300000000001},"last":18.940000000000001},{"interface":"front","average":{"1min":14.622999999999999,"5min":12.209,"15min":15.000999999999999},"min":{"1min":5.9889999999999999,"5min":5.3129999999999997,"15min":4.7670000000000003},"max":{"1min":111.852,"5min":111.852,"15min":180.934},"last":13.56}]},{"osd":1,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.305,"5min":17.294,"15min":20.532},"min":{"1min":6.9020000000000001,"5min":6.2030000000000003,"15min":5.7309999999999999},"max":{"1min":45.872999999999998,"5min":231.58799999999999,"15min":237.00800000000001},"last":7.3700000000000001},{"interface":"front","average":{"1min":14.226000000000001,"5min":16.335000000000001,"15min":23.113},"min":{"1min":6.8540000000000001,"5min":5.468,"15min":5.468},"max":{"1min":49.228999999999999,"5min":160.93700000000001,"15min":349.45100000000002},"last":17.350999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.260000000000002,"5min":19.155000000000001,"15min":23.353000000000002},"min":{"1min":8.327,"5min":6.9249999999999998,"15min":6.1890000000000001},"max":{"1min":41.594000000000001,"5min":189.38200000000001,"15min":317.30399999999997},"last":11.358000000000001},{"interface":"front","average":{"1min":16.364000000000001,"5min":21.843,"15min":22.341000000000001},"min":{"1min":8.532,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":51.375999999999998,"5min":260.46800000000002,"15min":260.46800000000002},"last":16.312999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":14.776,"5min":18.672000000000001,"15min":23.785},"min":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":54.658000000000001,"5min":165.47200000000001,"15min":421.14600000000002},"last":10.069000000000001},{"interface":"front","average":{"1min":19.300000000000001,"5min":19.853999999999999,"15min":26.306999999999999},"min":{"1min":8.3490000000000002,"5min":7.5960000000000001,"15min":7.1429999999999998},"max":{"1min":56.719999999999999,"5min":140.23099999999999,"15min":505.59199999999998},"last":8.2330000000000005}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":18.914000000000001,"5min":20.149000000000001,"15min":25.367999999999999},"min":{"1min":7.5830000000000002,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":104.053,"5min":137.20500000000001,"15min":326.33499999999998},"last":19.914000000000001},{"interface":"front","average":{"1min":22.571000000000002,"5min":21.366,"15min":26.219000000000001},"min":{"1min":10.512,"5min":9.2110000000000003,"15min":8.7469999999999999},"max":{"1min":113.79900000000001,"5min":133.33000000000001,"15min":272.53399999999999},"last":12.712999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.806000000000001,"5min":23.077000000000002,"15min":24.952999999999999},"min":{"1min":9.5030000000000001,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":47.222000000000001,"5min":350.44400000000002,"15min":483.47500000000002},"last":10.680999999999999},{"interface":"front","average":{"1min":20.527000000000001,"5min":27.356000000000002,"15min":31.510999999999999},"min":{"1min":9.9550000000000001,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":35.633000000000003,"5min":351.82100000000003,"15min":585.80600000000004},"last":14.526}]},{"osd":7,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":16.501999999999999,"5min":19.431000000000001,"15min":24.059999999999999},"min":{"1min":10.826000000000001,"5min":7.399,"15min":7.399},"max":{"1min":36.344000000000001,"5min":138.69900000000001,"15min":240.44200000000001},"last":27.715},{"interface":"front","average":{"1min":22.460999999999999,"5min":22.478999999999999,"15min":27.318000000000001},"min":{"1min":13.057,"5min":9.907,"15min":8.1669999999999998},"max":{"1min":49.140999999999998,"5min":138.05699999999999,"15min":342.57799999999997},"last":96.191000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:08.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-01T03:41:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.929+0000 7ff7b6fe2640 10 monclient: get_monmap_and_config 2023-11-01T03:41:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.929+0000 7ff7b6fe2640 10 monclient: build_initial_monmap 2023-11-01T03:41:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.929+0000 7ff7b6fe2640 10 monclient: monmap: 2023-11-01T03:41:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:08.931858+0000 2023-11-01T03:41:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:08.931858+0000 2023-11-01T03:41:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:08.934 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:08.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.930+0000 7ff7b6fe2640 1 Processor -- start 2023-11-01T03:41:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.930+0000 7ff7b6fe2640 1 -- start start 2023-11-01T03:41:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.930+0000 7ff7b6fe2640 10 monclient: init 2023-11-01T03:41:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2023-11-01T03:41:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7b00b4240 0x7ff7b00b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-a con 0x7ff7b00b4240 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff7b00b38d0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 0x7ff7b013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-b con 0x7ff7b00ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00b0cc0 con 0x7ff7b00b38d0 2023-11-01T03:41:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b00b4620 con 0x7ff7b00b4240 2023-11-01T03:41:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00b1690 con 0x7ff7b00ade00 2023-11-01T03:41:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.931+0000 7ff7b6fe2640 10 monclient(hunting): authenticate will time out at 2745.156447s 2023-11-01T03:41:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.937+0000 7ff7b4d7e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7b00b4240 0x7ff7b00b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.938+0000 7ff7b557f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 0x7ff7b013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.940+0000 7ff7affff640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff7b00b38d0 0x7ff7b00ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50896/0 (socket says 172.21.15.5:50896) 2023-11-01T03:41:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.940+0000 7ff7affff640 1 -- 172.21.15.5:0/1042953934 learned_addr learned my addr 172.21.15.5:0/1042953934 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.942+0000 7ff7b4d7e640 10 monclient(hunting): get_auth_request con 0x7ff7b00b4240 auth_method 0 2023-11-01T03:41:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.942+0000 7ff7b4d7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.942+0000 7ff7b4d7e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.942+0000 7ff7b4d7e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.944+0000 7ff7b557f640 10 monclient(hunting): get_auth_request con 0x7ff7b00ade00 auth_method 0 2023-11-01T03:41:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.944+0000 7ff7b557f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.944+0000 7ff7b557f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.944+0000 7ff7b557f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.945+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.945+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.945+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.947+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.947+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.947+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 1 -- 172.21.15.5:0/1042953934 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437916567 0 0) 0x7ff7b00b0cc0 con 0x7ff7b00b38d0 2023-11-01T03:41:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 10 monclient(hunting): _negotiate 2023-11-01T03:41:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 10 monclient(hunting): my global_id is 22168 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7af7fe640 1 -- 172.21.15.5:0/1042953934 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a0003520 con 0x7ff7b00b38d0 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 10 monclient(hunting): handle_auth_done global_id 17348 payload 274 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 1 -- 172.21.15.5:0/1042953934 >> v2:172.21.15.5:3300/0 conn(0x7ff7b00b4240 msgr2=0x7ff7b00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 1 --2- 172.21.15.5:0/1042953934 >> v2:172.21.15.5:3300/0 conn(0x7ff7b00b4240 0x7ff7b00b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 1 -- 172.21.15.5:0/1042953934 >> v1:172.21.15.153:6789/0 conn(0x7ff7b00b38d0 legacy=0x7ff7b00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 10 monclient: _finish_hunting 0 2023-11-01T03:41:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 1 monclient: found mon.noname-b 2023-11-01T03:41:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:08.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.949+0000 7ff7b557f640 1 -- 172.21.15.5:0/1042953934 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b013f5f0 con 0x7ff7b00ade00 2023-11-01T03:41:08.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:08.961+0000 7ff7b557f640 1 --2- 172.21.15.5:0/1042953934 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 0x7ff7b013b420 secure :-1 s=READY pgs=2892 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009dc0 tx=0x7ff7a802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92749c8001cd1ec5 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 1 -- 172.21.15.5:0/1042953934 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a802cbb0 con 0x7ff7b00ade00 2023-11-01T03:41:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: dump: 2023-11-01T03:41:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: _finish_auth 0 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 1 -- 172.21.15.5:0/1042953934 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a802cd10 con 0x7ff7b00ade00 2023-11-01T03:41:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 1 -- 172.21.15.5:0/1042953934 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8034660 con 0x7ff7b00ade00 2023-11-01T03:41:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7b6fe2640 5 monclient: authenticate success, global_id 17348 2023-11-01T03:41:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7b6fe2640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7b6fe2640 4 set_mon_vals no callback set 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.026+0000 7ff7af7fe640 10 monclient: dump: 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:09.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:09.035 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 10 monclient: shutdown 2023-11-01T03:41:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1042953934 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 msgr2=0x7ff7b013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1042953934 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 0x7ff7b013b420 secure :-1 s=READY pgs=2892 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009dc0 tx=0x7ff7a802be00 comp rx=0 tx=0).stop 2023-11-01T03:41:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1042953934 shutdown_connections 2023-11-01T03:41:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1042953934 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00ade00 0x7ff7b013b420 unknown :-1 s=CLOSED pgs=2892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1042953934 >> v2:172.21.15.5:3300/0 conn(0x7ff7b00b4240 0x7ff7b00b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1042953934 >> 172.21.15.5:0/1042953934 conn(0x7ff7b0065cd0 msgr2=0x7ff7b00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1042953934 shutdown_connections 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.027+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1042953934 wait complete. 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 10 monclient: build_initial_monmap 2023-11-01T03:41:09.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 10 monclient: monmap: 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:09.040 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 librados: starting msgr at 2023-11-01T03:41:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 librados: starting objecter 2023-11-01T03:41:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 Processor -- start 2023-11-01T03:41:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 -- start start 2023-11-01T03:41:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 librados: setting wanted keys 2023-11-01T03:41:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 1 librados: calling monclient init 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.028+0000 7ff7b6fe2640 10 monclient: init 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 0x7ff7b013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-a con 0x7ff7b00ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00b4240 0x7ff7b01d6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-c con 0x7ff7b00b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 0x7ff7b01d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): picked mon.noname-b con 0x7ff7b01d7160 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01d6a60 con 0x7ff7b00ade00 2023-11-01T03:41:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00a87e0 con 0x7ff7b01d7160 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01d6c40 con 0x7ff7b00b4240 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.029+0000 7ff7b6fe2640 10 monclient(hunting): authenticate will time out at 2745.254663s 2023-11-01T03:41:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.033+0000 7ff7b4d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 0x7ff7b013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.035+0000 7ff7b557f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 0x7ff7b01d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 0x7ff7b013ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55578/0 (socket says 172.21.15.5:55578) 2023-11-01T03:41:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 1 -- 172.21.15.5:0/1768317019 learned_addr learned my addr 172.21.15.5:0/1768317019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 10 monclient(hunting): get_auth_request con 0x7ff7b00ade00 auth_method 0 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b4d7e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b557f640 10 monclient(hunting): get_auth_request con 0x7ff7b01d7160 auth_method 0 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b557f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b557f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.036+0000 7ff7b557f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.038+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.038+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.038+0000 7ff7b557f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.039+0000 7ff7affff640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00b4240 0x7ff7b01d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:09.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.040+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.040+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.040+0000 7ff7b4d7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.041+0000 7ff7affff640 10 monclient(hunting): get_auth_request con 0x7ff7b00b4240 auth_method 0 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.041+0000 7ff7affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.041+0000 7ff7affff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:09.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.041+0000 7ff7affff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 10 monclient(hunting): handle_auth_done global_id 22171 payload 824 2023-11-01T03:41:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 -- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00b4240 msgr2=0x7ff7b01d6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00b4240 0x7ff7b01d6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 -- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 msgr2=0x7ff7b013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:09.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 0x7ff7b013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 10 monclient: _finish_hunting 0 2023-11-01T03:41:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 monclient: found mon.noname-b 2023-11-01T03:41:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:09.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.042+0000 7ff7b557f640 1 -- 172.21.15.5:0/1768317019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009a70 con 0x7ff7b01d7160 2023-11-01T03:41:09.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.051+0000 7ff7b557f640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 0x7ff7b01d9a40 secure :-1 s=READY pgs=5546 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8033000 tx=0x7ff7a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.051+0000 7ff7ad7fa640 10 client.?.objecter ms_handle_connect 0x7ff7b01d7160 2023-11-01T03:41:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.051+0000 7ff7ad7fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a803e610 con 0x7ff7b01d7160 2023-11-01T03:41:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: dump: 2023-11-01T03:41:09.061 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: _finish_auth 0 2023-11-01T03:41:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: _check_auth_tickets 2023-11-01T03:41:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a803e770 con 0x7ff7b01d7160 2023-11-01T03:41:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a803eb20 con 0x7ff7b01d7160 2023-11-01T03:41:09.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 5 monclient: authenticate success, global_id 22171 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 10 monclient: _renew_subs 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b01d9f80 con 0x7ff7b01d7160 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7aeffd640 4 set_mon_vals no callback set 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7ad7fa640 10 monclient: dump: 2023-11-01T03:41:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:09.067 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:09.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 10 client.22171.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:09.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 10 monclient: _renew_subs 2023-11-01T03:41:09.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:09.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b00acbc0 con 0x7ff7b01d7160 2023-11-01T03:41:09.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.059+0000 7ff7b6fe2640 1 librados: init done 2023-11-01T03:41:09.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.060+0000 7ff7b6fe2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:09.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.060+0000 7ff7b6fe2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:09.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.060+0000 7ff7b6fe2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:09.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.060+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b01da280 con 0x7ff7b01d7160 2023-11-01T03:41:09.133 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:10.443 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:09.134 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:10.444 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:09.143 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:10.453 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:09.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.309+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff7a803b050 con 0x7ff7b01d7160 2023-11-01T03:41:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.309+0000 7ff7ad7fa640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 0x7ff79406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:09.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.309+0000 7ff7b4d7e640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 0x7ff79406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.309+0000 7ff7b4d7e640 10 monclient: get_auth_request con 0x7ff79406c880 auth_method 0 2023-11-01T03:41:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.310+0000 7ff7ad7fa640 10 client.22171.objecter ms_handle_connect 0x7ff79406c880 2023-11-01T03:41:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.310+0000 7ff7b4d7e640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 0x7ff79406ed40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009b60 tx=0x7ff7a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:09.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.313+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ff7a807b680 con 0x7ff7b01d7160 2023-11-01T03:41:09.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.313+0000 7ff7ad7fa640 10 client.22171.objecter ms_dispatch 0x7ff7b0000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.313+0000 7ff7ad7fa640 3 client.22171.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.313+0000 7ff7ad7fa640 3 client.22171.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.313+0000 7ff7ad7fa640 20 client.22171.objecter dump_active .. 0 homeless 2023-11-01T03:41:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.322+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7a80772c0 con 0x7ff7b01d7160 2023-11-01T03:41:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.322+0000 7ff7ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.322+0000 7ff7ad7fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:09.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.523+0000 7ff7b6fe2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:41:09.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.523+0000 7ff7b6fe2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:41:09.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.523+0000 7ff7b6fe2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:09.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.523+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b00acd50 con 0x7ff7b01d7160 2023-11-01T03:41:09.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.558+0000 7ff7ad7fa640 1 -- 172.21.15.5:0/1768317019 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v902) v1 ==== 74+0+17337 (secure 0 0 0) 0x7ff7a8039090 con 0x7ff7b01d7160 2023-11-01T03:41:09.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.558+0000 7ff7ad7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-01T03:41:09.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.558+0000 7ff7ad7fa640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:41:09.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:09.561 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":902,"fsid":"7577fdb6-f4bf-4fa5-bdea-9d20c8455b32","created":"2023-11-01T03:18:11.461496+0000","modified":"2023-11-01T03:41:06.017931+0000","last_up_change":"2023-11-01T03:19:01.289052+0000","last_in_change":"2023-11-01T03:18:17.007564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":97,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":259,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-01T03:18:57.549549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-01T03:19:06.539615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"ceph_test_rados_api_asio","create_time":"2023-11-01T03:20:07.993246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"654b2e02-ec58-4b98-961c-a1db8e899315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6803","nonce":1232325411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6805","nonce":1232325411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6809","nonce":1232325411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1232325411},{"type":"v1","addr":"172.21.15.5:6807","nonce":1232325411}]},"public_addr":"172.21.15.5:6803/1232325411","cluster_addr":"172.21.15.5:6805/1232325411","heartbeat_back_addr":"172.21.15.5:6809/1232325411","heartbeat_front_addr":"172.21.15.5:6807/1232325411","state":["exists","up"]},{"osd":1,"uuid":"b99afca4-f146-40af-b59e-2136537920ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6827","nonce":1708816016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6829","nonce":1708816016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6833","nonce":1708816016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":1708816016},{"type":"v1","addr":"172.21.15.5:6831","nonce":1708816016}]},"public_addr":"172.21.15.5:6827/1708816016","cluster_addr":"172.21.15.5:6829/1708816016","heartbeat_back_addr":"172.21.15.5:6833/1708816016","heartbeat_front_addr":"172.21.15.5:6831/1708816016","state":["exists","up"]},{"osd":2,"uuid":"265251fa-4285-433b-8d1e-b71a60bc3336","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6819","nonce":4138368784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6821","nonce":4138368784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6825","nonce":4138368784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4138368784},{"type":"v1","addr":"172.21.15.5:6823","nonce":4138368784}]},"public_addr":"172.21.15.5:6819/4138368784","cluster_addr":"172.21.15.5:6821/4138368784","heartbeat_back_addr":"172.21.15.5:6825/4138368784","heartbeat_front_addr":"172.21.15.5:6823/4138368784","state":["exists","up"]},{"osd":3,"uuid":"96181d44-1a99-414d-baf7-738c2b83680f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6811","nonce":3809490384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6813","nonce":3809490384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6817","nonce":3809490384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3809490384},{"type":"v1","addr":"172.21.15.5:6815","nonce":3809490384}]},"public_addr":"172.21.15.5:6811/3809490384","cluster_addr":"172.21.15.5:6813/3809490384","heartbeat_back_addr":"172.21.15.5:6817/3809490384","heartbeat_front_addr":"172.21.15.5:6815/3809490384","state":["exists","up"]},{"osd":4,"uuid":"82bb6fe4-19eb-44a0-bef0-b04447166dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":893,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6825","nonce":439822656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6827","nonce":439822656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6831","nonce":439822656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":439822656},{"type":"v1","addr":"172.21.15.153:6829","nonce":439822656}]},"public_addr":"172.21.15.153:6825/439822656","cluster_addr":"172.21.15.153:6827/439822656","heartbeat_back_addr":"172.21.15.153:6831/439822656","heartbeat_front_addr":"172.21.15.153:6829/439822656","state":["exists","up"]},{"osd":5,"uuid":"4925d1dd-4b99-4ccb-bdc5-04ff10e3cf36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6817","nonce":3310991586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6819","nonce":3310991586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6823","nonce":3310991586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3310991586},{"type":"v1","addr":"172.21.15.153:6821","nonce":3310991586}]},"public_addr":"172.21.15.153:6817/3310991586","cluster_addr":"172.21.15.153:6819/3310991586","heartbeat_back_addr":"172.21.15.153:6823/3310991586","heartbeat_front_addr":"172.21.15.153:6821/3310991586","state":["exists","up"]},{"osd":6,"uuid":"43431aa9-f084-472d-9ad4-93d086ec158c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6801","nonce":1447491004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6803","nonce":1447491004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6807","nonce":1447491004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1447491004},{"type":"v1","addr":"172.21.15.153:6805","nonce":1447491004}]},"public_addr":"172.21.15.153:6801/1447491004","cluster_addr":"172.21.15.153:6803/1447491004","heartbeat_back_addr":"172.21.15.153:6807/1447491004","heartbeat_front_addr":"172.21.15.153:6805/1447491004","state":["exists","up"]},{"osd":7,"uuid":"d6398236-8588-413d-a391-4d52a96703b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":897,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6809","nonce":1714004960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6811","nonce":1714004960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6815","nonce":1714004960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1714004960},{"type":"v1","addr":"172.21.15.153:6813","nonce":1714004960}]},"public_addr":"172.21.15.153:6809/1714004960","cluster_addr":"172.21.15.153:6811/1714004960","heartbeat_back_addr":"172.21.15.153:6815/1714004960","heartbeat_front_addr":"172.21.15.153:6813/1714004960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.146757+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.507617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:57.834352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:58.104985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.169969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.604695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.024179+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-01T03:18:55.795171+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":9,"length":2}]},{"pool":18,"snaps":[{"begin":1,"length":1},{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":55,"snaps":[{"begin":11,"length":1}]},{"pool":83,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":94,"snaps":[{"begin":6,"length":2}]},{"pool":97,"snaps":[{"begin":2,"length":1}]},{"pool":112,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":123,"snaps":[{"begin":6,"length":2},{"begin":10,"length":2}]},{"pool":176,"snaps":[{"begin":12,"length":1}]},{"pool":186,"snaps":[{"begin":14,"length":1}]},{"pool":191,"snaps":[{"begin":17,"length":1}]},{"pool":193,"snaps":[{"begin":19,"length":2}]},{"pool":197,"snaps":[{"begin":24,"length":1}]},{"pool":240,"snaps":[{"begin":2,"length":1}]},{"pool":241,"snaps":[{"begin":4,"length":1}]},{"pool":244,"snaps":[{"begin":6,"length":1}]},{"pool":248,"snaps":[{"begin":9,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-01T03:41:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 10 librados: watch_flush enter 2023-11-01T03:41:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 10 librados: watch_flush exit 2023-11-01T03:41:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 20 client.22171.objecter shutdown clearing up homeless session... 2023-11-01T03:41:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 10 client.22171.objecter successfully canceled tick 2023-11-01T03:41:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 msgr2=0x7ff79406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 0x7ff79406ed40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009b60 tx=0x7ff7a4009190 comp rx=0 tx=0).stop 2023-11-01T03:41:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 10 monclient: shutdown 2023-11-01T03:41:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 msgr2=0x7ff7b01d9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.560+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 0x7ff7b01d9a40 secure :-1 s=READY pgs=5546 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8033000 tx=0x7ff7a8004a40 comp rx=0 tx=0).stop 2023-11-01T03:41:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 shutdown_connections 2023-11-01T03:41:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ff79406c880 0x7ff79406ed40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b01d7160 0x7ff7b01d9a40 unknown :-1 s=CLOSED pgs=5546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff7b00b4240 0x7ff7b01d6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 --2- 172.21.15.5:0/1768317019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b00ade00 0x7ff7b013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 >> 172.21.15.5:0/1768317019 conn(0x7ff7b0065cd0 msgr2=0x7ff7b00660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 shutdown_connections 2023-11-01T03:41:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 -- 172.21.15.5:0/1768317019 wait complete. 2023-11-01T03:41:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:09.561+0000 7ff7b6fe2640 1 librados: shutdown 2023-11-01T03:41:10.575 INFO:tasks.ceph:Scrubbing osd.0 2023-11-01T03:41:10.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:10.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: get_monmap_and_config 2023-11-01T03:41:10.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: build_initial_monmap 2023-11-01T03:41:10.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: monmap: 2023-11-01T03:41:10.695 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:10.695 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.695 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:10.694581+0000 2023-11-01T03:41:10.695 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:10.694581+0000 2023-11-01T03:41:10.695 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:10.696 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:10.697 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 Processor -- start 2023-11-01T03:41:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 -- start start 2023-11-01T03:41:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: init 2023-11-01T03:41:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2023-11-01T03:41:10.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b1c0ae9e0 0x7f2b1c0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-a con 0x7f2b1c0ae9e0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2b1c0a6d50 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2b1c0a71c0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0ab810 con 0x7f2b1c0a6d50 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0abaf0 con 0x7f2b1c0a71c0 2023-11-01T03:41:10.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a7650 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.693+0000 7f2b21105640 10 monclient(hunting): authenticate will time out at 2746.918878s 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b1c0ae9e0 0x7f2b1c0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1b59e640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b1c0a71c0 0x7f2b1c0aa5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50900/0 (socket says 172.21.15.5:50900) 2023-11-01T03:41:10.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1b59e640 1 -- 172.21.15.5:0/3786431886 learned_addr learned my addr 172.21.15.5:0/3786431886 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1ad9d640 10 monclient(hunting): get_auth_request con 0x7f2b1c0ae9e0 auth_method 0 2023-11-01T03:41:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.694+0000 7f2b1ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.695+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.695+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.695+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 1 -- 172.21.15.5:0/3786431886 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981782116 0 0) 0x7f2b1c0abaf0 con 0x7f2b1c0a71c0 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 10 monclient(hunting): _negotiate 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 10 monclient(hunting): my global_id is 22174 2023-11-01T03:41:10.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.698+0000 7f2b1a59c640 1 -- 172.21.15.5:0/3786431886 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b08003520 con 0x7f2b1c0a71c0 2023-11-01T03:41:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_done global_id 15387 payload 274 2023-11-01T03:41:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 1 -- 172.21.15.5:0/3786431886 >> v1:172.21.15.153:6789/0 conn(0x7f2b1c0a71c0 legacy=0x7f2b1c0aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 1 -- 172.21.15.5:0/3786431886 >> v1:172.21.15.5:6789/0 conn(0x7f2b1c0a6d50 legacy=0x7f2b1c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 10 monclient: _finish_hunting 0 2023-11-01T03:41:10.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 1 monclient: found mon.noname-a 2023-11-01T03:41:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.699+0000 7f2b1ad9d640 1 -- 172.21.15.5:0/3786431886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0aacd0 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.702+0000 7f2b1ad9d640 1 --2- 172.21.15.5:0/3786431886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c0abf80 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0097a0 tx=0x7f2b0c02dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bdaf64f797264a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 1 -- 172.21.15.5:0/3786431886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c02f8a0 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: dump: 2023-11-01T03:41:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.709 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: _finish_auth 0 2023-11-01T03:41:10.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: _check_auth_tickets 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 1 -- 172.21.15.5:0/3786431886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c02fa00 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 1 -- 172.21.15.5:0/3786431886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c02fd90 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b1a59c640 10 monclient: dump: 2023-11-01T03:41:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.712 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.713 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b21105640 5 monclient: authenticate success, global_id 15387 2023-11-01T03:41:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b21105640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:10.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.706+0000 7f2b21105640 4 set_mon_vals no callback set 2023-11-01T03:41:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 10 monclient: shutdown 2023-11-01T03:41:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 -- 172.21.15.5:0/3786431886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0ae9e0 msgr2=0x7f2b1c0abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 --2- 172.21.15.5:0/3786431886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c0abf80 secure :-1 s=READY pgs=2988 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0097a0 tx=0x7f2b0c02dae0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 -- 172.21.15.5:0/3786431886 shutdown_connections 2023-11-01T03:41:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 --2- 172.21.15.5:0/3786431886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c0abf80 unknown :-1 s=CLOSED pgs=2988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 -- 172.21.15.5:0/3786431886 >> 172.21.15.5:0/3786431886 conn(0x7f2b1c069dd0 msgr2=0x7f2b1c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 -- 172.21.15.5:0/3786431886 shutdown_connections 2023-11-01T03:41:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.707+0000 7f2b21105640 1 -- 172.21.15.5:0/3786431886 wait complete. 2023-11-01T03:41:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 10 monclient: build_initial_monmap 2023-11-01T03:41:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 10 monclient: monmap: 2023-11-01T03:41:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.720 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:10.721 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 librados: starting msgr at 2023-11-01T03:41:10.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 librados: starting objecter 2023-11-01T03:41:10.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 Processor -- start 2023-11-01T03:41:10.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 -- start start 2023-11-01T03:41:10.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 librados: setting wanted keys 2023-11-01T03:41:10.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 1 librados: calling monclient init 2023-11-01T03:41:10.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.708+0000 7f2b21105640 10 monclient: init 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b1c0a6d50 0x7f2b1c1c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-c con 0x7f2b1c0a6d50 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0a71c0 0x7f2b1c1cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-a con 0x7f2b1c0a71c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c1d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): picked mon.noname-b con 0x7f2b1c0ae9e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a9830 con 0x7f2b1c0a71c0 2023-11-01T03:41:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a7c30 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a7f10 con 0x7f2b1c0a6d50 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.709+0000 7f2b21105640 10 monclient(hunting): authenticate will time out at 2746.934502s 2023-11-01T03:41:10.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b1c0a6d50 0x7f2b1c1c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0a71c0 0x7f2b1c1cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c1d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b1c0a6d50 0x7f2b1c1c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:46988/0 (socket says 172.21.15.5:46988) 2023-11-01T03:41:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): get_auth_request con 0x7f2b1c0ae9e0 auth_method 0 2023-11-01T03:41:10.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 1 -- 172.21.15.5:0/3354500684 learned_addr learned my addr 172.21.15.5:0/3354500684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 10 monclient(hunting): get_auth_request con 0x7f2b1c0a6d50 auth_method 0 2023-11-01T03:41:10.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1259c640 10 monclient(hunting): get_auth_request con 0x7f2b1c0a71c0 auth_method 0 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1259c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.710+0000 7f2b1b59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.711+0000 7f2b1259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 10 monclient(hunting): handle_auth_done global_id 22177 payload 824 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 -- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b1c0a6d50 msgr2=0x7f2b1c1c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f2b1c0a6d50 0x7f2b1c1c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 -- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0a71c0 msgr2=0x7f2b1c1cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b1c0a71c0 0x7f2b1c1cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 10 monclient: _finish_hunting 0 2023-11-01T03:41:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 monclient: found mon.noname-b 2023-11-01T03:41:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.713+0000 7f2b1b59e640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009400 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.715+0000 7f2b1b59e640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c1d6b20 secure :-1 s=READY pgs=5548 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400cab0 tx=0x7f2b1400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.715+0000 7f2b13fff640 10 client.?.objecter ms_handle_connect 0x7f2b1c0ae9e0 2023-11-01T03:41:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.715+0000 7f2b13fff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400ac30 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: dump: 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1400ad90 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14012600 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b13fff640 10 monclient: dump: 2023-11-01T03:41:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.738 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 5 monclient: authenticate success, global_id 22177 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 monclient: _renew_subs 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b19d9b640 4 set_mon_vals no callback set 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c0a8430 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 client.22177.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 monclient: _renew_subs 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c1d7060 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 1 librados: init done 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 client.22177.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:10.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 15 client.22177.objecter _session_command_op_assign -1 1 2023-11-01T03:41:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 20 client.22177.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 client.22177.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.720+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b1c0ace00 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2b14007070 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b13fff640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2afc06c850 0x7f2afc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b1ad9d640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2afc06c850 0x7f2afc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b1ad9d640 10 monclient: get_auth_request con 0x7f2afc06c850 auth_method 0 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b13fff640 10 client.22177.objecter ms_handle_connect 0x7f2afc06c850 2023-11-01T03:41:10.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.739+0000 7f2b1ad9d640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2afc06c850 0x7f2afc06ed10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c02db20 tx=0x7f2b0c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f2b14058b30 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 10 client.22177.objecter ms_dispatch 0x7f2b1c000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 3 client.22177.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 3 client.22177.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:10.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 10 client.22177.objecter checking command 1 2023-11-01T03:41:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f2afc0740b0 0x7f2afc076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter _get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 15 client.22177.objecter _session_command_op_remove -1 1 2023-11-01T03:41:10.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter _get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 15 client.22177.objecter _session_command_op_assign 0 1 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 4 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 10 client.22177.objecter _send_command 1 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2afc076c20 con 0x7f2afc0740b0 2023-11-01T03:41:10.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.740+0000 7f2b13fff640 20 client.22177.objecter dump_active .. 0 homeless 2023-11-01T03:41:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.741+0000 7f2b1259c640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f2afc0740b0 0x7f2afc076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.741+0000 7f2b1259c640 10 monclient: get_auth_request con 0x7f2afc0740b0 auth_method 0 2023-11-01T03:41:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.742+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b14054e70 con 0x7f2b1c0ae9e0 2023-11-01T03:41:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.742+0000 7f2b13fff640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.744+0000 7f2b13fff640 10 client.22177.objecter ms_handle_connect 0x7f2afc0740b0 2023-11-01T03:41:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.744+0000 7f2b1259c640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f2afc0740b0 0x7f2afc076550 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.768+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== osd.0 v2:172.21.15.5:6802/1232325411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2afc076c20 con 0x7f2afc0740b0 2023-11-01T03:41:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.768+0000 7f2b13fff640 10 client.22177.objecter ms_dispatch 0x7f2b1c000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:10.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.768+0000 7f2b13fff640 10 client.22177.objecter _finish_command 1 = system:0 2023-11-01T03:41:10.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.768+0000 7f2b13fff640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 4 2023-11-01T03:41:10.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.768+0000 7f2b13fff640 15 client.22177.objecter _session_command_op_remove 0 1 2023-11-01T03:41:10.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 10 client.22177.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:10.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 15 client.22177.objecter _session_command_op_assign -1 2 2023-11-01T03:41:10.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 20 client.22177.objecter _get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 20 client.22177.objecter _get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 15 client.22177.objecter _session_command_op_remove -1 2 2023-11-01T03:41:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 20 client.22177.objecter get_session s=0x7f2afc0739e0 osd=0 3 2023-11-01T03:41:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 15 client.22177.objecter _session_command_op_assign 0 2 2023-11-01T03:41:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 4 2023-11-01T03:41:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 10 client.22177.objecter _send_command 2 2023-11-01T03:41:10.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.781+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 --> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b1c0acb20 con 0x7f2afc0740b0 2023-11-01T03:41:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.795+0000 7f2b13fff640 1 -- 172.21.15.5:0/3354500684 <== osd.0 v2:172.21.15.5:6802/1232325411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2b040014c0 con 0x7f2afc0740b0 2023-11-01T03:41:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.795+0000 7f2b13fff640 10 client.22177.objecter ms_dispatch 0x7f2b1c000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.795+0000 7f2b13fff640 10 client.22177.objecter _finish_command 2 = system:0 2023-11-01T03:41:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.795+0000 7f2b13fff640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 4 2023-11-01T03:41:10.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.795+0000 7f2b13fff640 15 client.22177.objecter _session_command_op_remove 0 2 2023-11-01T03:41:10.798 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:10.798 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:10.799 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 10 librados: watch_flush enter 2023-11-01T03:41:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 10 librados: watch_flush exit 2023-11-01T03:41:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 10 client.22177.objecter close_session for osd.0 2023-11-01T03:41:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f2afc0740b0 msgr2=0x7f2afc076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6802/1232325411,v1:172.21.15.5:6803/1232325411] conn(0x7f2afc0740b0 0x7f2afc076550 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 20 client.22177.objecter put_session s=0x7f2afc0739e0 osd=0 1 2023-11-01T03:41:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 20 client.22177.objecter shutdown clearing up homeless session... 2023-11-01T03:41:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 10 client.22177.objecter successfully canceled tick 2023-11-01T03:41:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2afc06c850 msgr2=0x7f2afc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f2afc06c850 0x7f2afc06ed10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c02db20 tx=0x7f2b0c03b040 comp rx=0 tx=0).stop 2023-11-01T03:41:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 10 monclient: shutdown 2023-11-01T03:41:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0ae9e0 msgr2=0x7f2b1c1d6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 --2- 172.21.15.5:0/3354500684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0ae9e0 0x7f2b1c1d6b20 secure :-1 s=READY pgs=5548 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400cab0 tx=0x7f2b1400cf70 comp rx=0 tx=0).stop 2023-11-01T03:41:10.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b1b59e640 1 -- 172.21.15.5:0/3354500684 reap_dead start 2023-11-01T03:41:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 shutdown_connections 2023-11-01T03:41:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 >> 172.21.15.5:0/3354500684 conn(0x7f2b1c069dd0 msgr2=0x7f2b1c1c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 shutdown_connections 2023-11-01T03:41:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 -- 172.21.15.5:0/3354500684 wait complete. 2023-11-01T03:41:10.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.796+0000 7f2b21105640 1 librados: shutdown 2023-11-01T03:41:10.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-01T03:41:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 10 monclient: get_monmap_and_config 2023-11-01T03:41:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 10 monclient: build_initial_monmap 2023-11-01T03:41:10.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 10 monclient: monmap: 2023-11-01T03:41:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:10.915866+0000 2023-11-01T03:41:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:10.915866+0000 2023-11-01T03:41:10.916 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:10.918 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 1 Processor -- start 2023-11-01T03:41:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 1 -- start start 2023-11-01T03:41:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.914+0000 7fcfa8325640 10 monclient: init 2023-11-01T03:41:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2023-11-01T03:41:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfa006bbe0 0x7fcfa006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-c con 0x7fcfa006bbe0 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-b con 0x7fcfa006b1d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfa00718f0 0x7fcfa0141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-a con 0x7fcfa00718f0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa0071d80 con 0x7fcfa00718f0 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa006c500 con 0x7fcfa006bbe0 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa006c790 con 0x7fcfa006b1d0 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa8325640 10 monclient(hunting): authenticate will time out at 2747.140336s 2023-11-01T03:41:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.915+0000 7fcfa58c0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcfa006bbe0 0x7fcfa006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa68c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfa00718f0 0x7fcfa0141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47002/0 (socket says 172.21.15.5:47002) 2023-11-01T03:41:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 1 -- 172.21.15.5:0/2974483153 learned_addr learned my addr 172.21.15.5:0/2974483153 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): get_auth_request con 0x7fcfa006b1d0 auth_method 0 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): get_auth_request con 0x7fcfa006bbe0 auth_method 0 2023-11-01T03:41:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa68c2640 10 monclient(hunting): get_auth_request con 0x7fcfa00718f0 auth_method 0 2023-11-01T03:41:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa68c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa68c2640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa68c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.916+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.917+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.917+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.917+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_done global_id 17357 payload 274 2023-11-01T03:41:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 -- 172.21.15.5:0/2974483153 >> v2:172.21.15.153:3300/0 conn(0x7fcfa006bbe0 msgr2=0x7fcfa006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 --2- 172.21.15.5:0/2974483153 >> v2:172.21.15.153:3300/0 conn(0x7fcfa006bbe0 0x7fcfa006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 -- 172.21.15.5:0/2974483153 >> v2:172.21.15.5:3300/0 conn(0x7fcfa00718f0 msgr2=0x7fcfa0141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 --2- 172.21.15.5:0/2974483153 >> v2:172.21.15.5:3300/0 conn(0x7fcfa00718f0 0x7fcfa0141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 10 monclient: _finish_hunting 0 2023-11-01T03:41:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 monclient: found mon.noname-b 2023-11-01T03:41:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:10.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.918+0000 7fcfa58c0640 1 -- 172.21.15.5:0/2974483153 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0072160 con 0x7fcfa006b1d0 2023-11-01T03:41:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.921+0000 7fcfa58c0640 1 --2- 172.21.15.5:0/2974483153 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 secure :-1 s=READY pgs=2893 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00b5d00 tx=0x7fcf9402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e081698121be68 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 1 -- 172.21.15.5:0/2974483153 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940317e0 con 0x7fcfa006b1d0 2023-11-01T03:41:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:10.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: dump: 2023-11-01T03:41:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: _finish_auth 0 2023-11-01T03:41:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: _check_auth_tickets 2023-11-01T03:41:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 1 -- 172.21.15.5:0/2974483153 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94031940 con 0x7fcfa006b1d0 2023-11-01T03:41:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:10.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 1 -- 172.21.15.5:0/2974483153 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94031cd0 con 0x7fcfa006b1d0 2023-11-01T03:41:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 5 monclient: authenticate success, global_id 17357 2023-11-01T03:41:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 4 set_mon_vals no callback set 2023-11-01T03:41:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa50bf640 10 monclient: dump: 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 10 monclient: shutdown 2023-11-01T03:41:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 1 -- 172.21.15.5:0/2974483153 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 msgr2=0x7fcfa00713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.924+0000 7fcfa8325640 1 --2- 172.21.15.5:0/2974483153 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 secure :-1 s=READY pgs=2893 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00b5d00 tx=0x7fcf9402b880 comp rx=0 tx=0).stop 2023-11-01T03:41:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 -- 172.21.15.5:0/2974483153 shutdown_connections 2023-11-01T03:41:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 --2- 172.21.15.5:0/2974483153 >> v2:172.21.15.5:3300/0 conn(0x7fcfa00718f0 0x7fcfa0141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 --2- 172.21.15.5:0/2974483153 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00713b0 unknown :-1 s=CLOSED pgs=2893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 --2- 172.21.15.5:0/2974483153 >> v2:172.21.15.153:3300/0 conn(0x7fcfa006bbe0 0x7fcfa006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 -- 172.21.15.5:0/2974483153 >> 172.21.15.5:0/2974483153 conn(0x7fcfa00665e0 msgr2=0x7fcfa00b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 -- 172.21.15.5:0/2974483153 shutdown_connections 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 1 -- 172.21.15.5:0/2974483153 wait complete. 2023-11-01T03:41:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 10 monclient: build_initial_monmap 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.925+0000 7fcfa8325640 10 monclient: monmap: 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:10.943 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:10.944 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.944 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:10.944 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:10.944 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:10.944 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 librados: starting msgr at 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 librados: starting objecter 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 Processor -- start 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 -- start start 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 librados: setting wanted keys 2023-11-01T03:41:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 librados: calling monclient init 2023-11-01T03:41:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient: init 2023-11-01T03:41:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:41:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-c con 0x7fcfa006b1d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa006bbe0 0x7fcfa00aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-a con 0x7fcfa006bbe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 0x7fcfa01d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): picked mon.noname-b con 0x7fcfa00718f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00af3e0 con 0x7fcfa006bbe0 2023-11-01T03:41:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01d99b0 con 0x7fcfa00718f0 2023-11-01T03:41:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00ae700 con 0x7fcfa006b1d0 2023-11-01T03:41:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.926+0000 7fcfa8325640 10 monclient(hunting): authenticate will time out at 2747.151881s 2023-11-01T03:41:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47012/0 (socket says 172.21.15.5:47012) 2023-11-01T03:41:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 1 -- 172.21.15.5:0/1830050092 learned_addr learned my addr 172.21.15.5:0/1830050092 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 10 monclient(hunting): get_auth_request con 0x7fcfa006b1d0 auth_method 0 2023-11-01T03:41:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa60c1640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa68c2640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 0x7fcfa01d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa58c0640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa006bbe0 0x7fcfa00aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa68c2640 10 monclient(hunting): get_auth_request con 0x7fcfa00718f0 auth_method 0 2023-11-01T03:41:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa68c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa68c2640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.927+0000 7fcfa68c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): get_auth_request con 0x7fcfa006bbe0 auth_method 0 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa60c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.928+0000 7fcfa58c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 10 monclient(hunting): handle_auth_done global_id 22183 payload 824 2023-11-01T03:41:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 -- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 msgr2=0x7fcfa00a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 -- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa006bbe0 msgr2=0x7fcfa00aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa006bbe0 0x7fcfa00aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 10 monclient: _finish_hunting 0 2023-11-01T03:41:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 monclient: found mon.noname-b 2023-11-01T03:41:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.932+0000 7fcfa68c2640 1 -- 172.21.15.5:0/1830050092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094d0 con 0x7fcfa00718f0 2023-11-01T03:41:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.934+0000 7fcfa68c2640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 0x7fcfa01d9ed0 secure :-1 s=READY pgs=5549 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e820 tx=0x7fcf9000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.934+0000 7fcf9effd640 10 client.?.objecter ms_handle_connect 0x7fcfa00718f0 2023-11-01T03:41:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.934+0000 7fcf9effd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90009590 con 0x7fcfa00718f0 2023-11-01T03:41:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: dump: 2023-11-01T03:41:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.960 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: _finish_auth 0 2023-11-01T03:41:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000c940 con 0x7fcfa00718f0 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 5 monclient: authenticate success, global_id 22183 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _renew_subs 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000ccd0 con 0x7fcfa00718f0 2023-11-01T03:41:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa00adac0 con 0x7fcfa00718f0 2023-11-01T03:41:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9ffff640 4 set_mon_vals no callback set 2023-11-01T03:41:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcf9effd640 10 monclient: dump: 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 client.22183.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _renew_subs 2023-11-01T03:41:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00aaa30 con 0x7fcfa00718f0 2023-11-01T03:41:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 1 librados: init done 2023-11-01T03:41:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:10.938+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa01d9bd0 con 0x7fcfa00718f0 2023-11-01T03:41:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.188+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf90004020 con 0x7fcfa00718f0 2023-11-01T03:41:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.188+0000 7fcf9effd640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 0x7fcf8c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.189+0000 7fcfa60c1640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 0x7fcf8c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.189+0000 7fcfa60c1640 10 monclient: get_auth_request con 0x7fcf8c06c850 auth_method 0 2023-11-01T03:41:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.189+0000 7fcfa60c1640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 0x7fcf8c06ed10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009a40 tx=0x7fcf9800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.189+0000 7fcf9effd640 10 client.22183.objecter ms_handle_connect 0x7fcf8c06c850 2023-11-01T03:41:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.191+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fcf90058490 con 0x7fcfa00718f0 2023-11-01T03:41:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.191+0000 7fcf9effd640 10 client.22183.objecter ms_dispatch 0x7fcfa0000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.191+0000 7fcf9effd640 3 client.22183.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.191+0000 7fcf9effd640 3 client.22183.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.191+0000 7fcf9effd640 20 client.22183.objecter dump_active .. 0 homeless 2023-11-01T03:41:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.200+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf900547d0 con 0x7fcfa00718f0 2023-11-01T03:41:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.200+0000 7fcf9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.200+0000 7fcf9effd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:11.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.379+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfa004e9f0 con 0x7fcf8c06c850 2023-11-01T03:41:11.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.380+0000 7fcf9effd640 1 -- 172.21.15.5:0/1830050092 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcfa004e9f0 con 0x7fcf8c06c850 2023-11-01T03:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2023-11-01T03:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 10 librados: watch_flush enter 2023-11-01T03:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 10 librados: watch_flush exit 2023-11-01T03:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 20 client.22183.objecter shutdown clearing up homeless session... 2023-11-01T03:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 10 client.22183.objecter successfully canceled tick 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 msgr2=0x7fcf8c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 0x7fcf8c06ed10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009a40 tx=0x7fcf9800d040 comp rx=0 tx=0).stop 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 10 monclient: shutdown 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 msgr2=0x7fcfa01d9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 0x7fcfa01d9ed0 secure :-1 s=READY pgs=5549 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e820 tx=0x7fcf9000ece0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 shutdown_connections 2023-11-01T03:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fcf8c06c850 0x7fcf8c06ed10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfa00718f0 0x7fcfa01d9ed0 unknown :-1 s=CLOSED pgs=5549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa006bbe0 0x7fcfa00aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 --2- 172.21.15.5:0/1830050092 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fcfa006b1d0 0x7fcfa00a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 >> 172.21.15.5:0/1830050092 conn(0x7fcfa00665e0 msgr2=0x7fcfa00b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 shutdown_connections 2023-11-01T03:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 -- 172.21.15.5:0/1830050092 wait complete. 2023-11-01T03:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.383+0000 7fcfa8325640 1 librados: shutdown 2023-11-01T03:41:11.394 INFO:tasks.ceph:Scrubbing osd.1 2023-11-01T03:41:11.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.504+0000 7f384bba5640 10 monclient: get_monmap_and_config 2023-11-01T03:41:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.504+0000 7f384bba5640 10 monclient: build_initial_monmap 2023-11-01T03:41:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.504+0000 7f384bba5640 10 monclient: monmap: 2023-11-01T03:41:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:11.505442+0000 2023-11-01T03:41:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:11.505442+0000 2023-11-01T03:41:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:11.508 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 Processor -- start 2023-11-01T03:41:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 -- start start 2023-11-01T03:41:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient: init 2023-11-01T03:41:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38440b42c0 0x7f38440a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f38440b42c0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f38440a8770 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f384413f300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440a8d00 con 0x7f38440a8770 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38440b46a0 con 0x7f38440b42c0 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440ade80 con 0x7f384413f300 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:11.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.505+0000 7f384bba5640 10 monclient(hunting): authenticate will time out at 2747.729907s 2023-11-01T03:41:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f3849941640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38440b42c0 0x7f38440a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47022/0 (socket says 172.21.15.5:47022) 2023-11-01T03:41:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 1 -- 172.21.15.5:0/1277191023 learned_addr learned my addr 172.21.15.5:0/1277191023 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 10 monclient(hunting): get_auth_request con 0x7f384413f300 auth_method 0 2023-11-01T03:41:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f384a142640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.506+0000 7f3849941640 10 monclient(hunting): get_auth_request con 0x7f38440b42c0 auth_method 0 2023-11-01T03:41:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.507+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 1 -- 172.21.15.5:0/1277191023 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848810629 0 0) 0x7f38440a8d00 con 0x7f38440a8770 2023-11-01T03:41:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 10 monclient(hunting): _negotiate 2023-11-01T03:41:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 10 monclient(hunting): my global_id is 22186 2023-11-01T03:41:11.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384893f640 1 -- 172.21.15.5:0/1277191023 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3830003520 con 0x7f38440a8770 2023-11-01T03:41:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 10 monclient(hunting): handle_auth_done global_id 17363 payload 274 2023-11-01T03:41:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 1 -- 172.21.15.5:0/1277191023 >> v2:172.21.15.5:3300/0 conn(0x7f38440b42c0 msgr2=0x7f38440a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:11.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 1 --2- 172.21.15.5:0/1277191023 >> v2:172.21.15.5:3300/0 conn(0x7f38440b42c0 0x7f38440a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 1 -- 172.21.15.5:0/1277191023 >> v1:172.21.15.153:6789/0 conn(0x7f38440a8770 legacy=0x7f384413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 10 monclient: _finish_hunting 0 2023-11-01T03:41:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 1 monclient: found mon.noname-b 2023-11-01T03:41:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.509+0000 7f384a142640 1 -- 172.21.15.5:0/1277191023 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440adfc0 con 0x7f384413f300 2023-11-01T03:41:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.512+0000 7f384a142640 1 --2- 172.21.15.5:0/1277191023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 secure :-1 s=READY pgs=2894 cs=0 l=1 rev1=1 crypto rx=0x7f383c009e50 tx=0x7f383c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7e2cc42361ec91 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.518+0000 7f384893f640 1 -- 172.21.15.5:0/1277191023 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c02c9e0 con 0x7f384413f300 2023-11-01T03:41:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.518+0000 7f384893f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: dump: 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.526 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: _finish_auth 0 2023-11-01T03:41:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: _check_auth_tickets 2023-11-01T03:41:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 1 -- 172.21.15.5:0/1277191023 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c02cb40 con 0x7f384413f300 2023-11-01T03:41:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:11.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 1 -- 172.21.15.5:0/1277191023 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0343f0 con 0x7f384413f300 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 5 monclient: authenticate success, global_id 17363 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 4 set_mon_vals no callback set 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384893f640 10 monclient: dump: 2023-11-01T03:41:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.530 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 10 monclient: shutdown 2023-11-01T03:41:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 -- 172.21.15.5:0/1277191023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 msgr2=0x7f3844144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 --2- 172.21.15.5:0/1277191023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 secure :-1 s=READY pgs=2894 cs=0 l=1 rev1=1 crypto rx=0x7f383c009e50 tx=0x7f383c02be40 comp rx=0 tx=0).stop 2023-11-01T03:41:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 -- 172.21.15.5:0/1277191023 shutdown_connections 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 --2- 172.21.15.5:0/1277191023 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f3844144f60 unknown :-1 s=CLOSED pgs=2894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 --2- 172.21.15.5:0/1277191023 >> v2:172.21.15.5:3300/0 conn(0x7f38440b42c0 0x7f38440a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 -- 172.21.15.5:0/1277191023 >> 172.21.15.5:0/1277191023 conn(0x7f3844065ee0 msgr2=0x7f38440662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 -- 172.21.15.5:0/1277191023 shutdown_connections 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.519+0000 7f384bba5640 1 -- 172.21.15.5:0/1277191023 wait complete. 2023-11-01T03:41:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.520+0000 7f384bba5640 10 monclient: build_initial_monmap 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.520+0000 7f384bba5640 10 monclient: monmap: 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.520+0000 7f384bba5640 1 librados: starting msgr at 2023-11-01T03:41:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.520+0000 7f384bba5640 1 librados: starting objecter 2023-11-01T03:41:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 Processor -- start 2023-11-01T03:41:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 -- start start 2023-11-01T03:41:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 librados: setting wanted keys 2023-11-01T03:41:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 librados: calling monclient init 2023-11-01T03:41:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient: init 2023-11-01T03:41:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38440a8770 0x7f38440ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f38440a8770 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38440b42c0 0x7f38440b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f38440b42c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f38441d99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): picked mon.noname-c con 0x7f384413f300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440af550 con 0x7f38440b42c0 2023-11-01T03:41:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440b0e20 con 0x7f38440a8770 2023-11-01T03:41:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440b1090 con 0x7f384413f300 2023-11-01T03:41:11.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.521+0000 7f384bba5640 10 monclient(hunting): authenticate will time out at 2747.745793s 2023-11-01T03:41:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f38441d99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f3849941640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38440a8770 0x7f38440ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f38441d99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47036/0 (socket says 172.21.15.5:47036) 2023-11-01T03:41:11.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 1 -- 172.21.15.5:0/2516213309 learned_addr learned my addr 172.21.15.5:0/2516213309 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 10 monclient(hunting): get_auth_request con 0x7f384413f300 auth_method 0 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f384a142640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f3849941640 10 monclient(hunting): get_auth_request con 0x7f38440a8770 auth_method 0 2023-11-01T03:41:11.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f3849941640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f3849941640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.522+0000 7f3849941640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f384a142640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.523+0000 7f3849941640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 10 monclient(hunting): handle_auth_done global_id 22189 payload 824 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 -- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 msgr2=0x7f38441d99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f384413f300 0x7f38441d99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 -- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38440b42c0 msgr2=0x7f38440b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38440b42c0 0x7f38440b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 10 monclient: _finish_hunting 0 2023-11-01T03:41:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 monclient: found mon.noname-b 2023-11-01T03:41:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.525+0000 7f3849941640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c009b30 con 0x7f38440a8770 2023-11-01T03:41:11.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.528+0000 7f3849941640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38440a8770 0x7f38440ad440 secure :-1 s=READY pgs=5553 cs=0 l=1 rev1=1 crypto rx=0x7f384000e850 tx=0x7f384000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.528+0000 7f383a7fc640 10 client.?.objecter ms_handle_connect 0x7f38440a8770 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.528+0000 7f383a7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400095b0 con 0x7f38440a8770 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:11.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: dump: 2023-11-01T03:41:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.547 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.548 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384000c940 con 0x7f38440a8770 2023-11-01T03:41:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384000ccd0 con 0x7f38440a8770 2023-11-01T03:41:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383a7fc640 10 monclient: dump: 2023-11-01T03:41:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 5 monclient: authenticate success, global_id 22189 2023-11-01T03:41:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 10 monclient: _renew_subs 2023-11-01T03:41:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f383bfff640 4 set_mon_vals no callback set 2023-11-01T03:41:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440affd0 con 0x7f38440a8770 2023-11-01T03:41:11.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 10 client.22189.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 10 monclient: _renew_subs 2023-11-01T03:41:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38441da0e0 con 0x7f38440a8770 2023-11-01T03:41:11.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.531+0000 7f384bba5640 1 librados: init done 2023-11-01T03:41:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 10 client.22189.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 15 client.22189.objecter _session_command_op_assign -1 1 2023-11-01T03:41:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 20 client.22189.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:11.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 10 client.22189.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.532+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38440667f0 con 0x7f38440a8770 2023-11-01T03:41:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.551+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3840013470 con 0x7f38440a8770 2023-11-01T03:41:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.551+0000 7f383a7fc640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f382806c850 0x7f382806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.551+0000 7f3849140640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f382806c850 0x7f382806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.551+0000 7f3849140640 10 monclient: get_auth_request con 0x7f382806c850 auth_method 0 2023-11-01T03:41:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.552+0000 7f3849140640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f382806c850 0x7f382806ed10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38340011e0 tx=0x7f38340078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.552+0000 7f383a7fc640 10 client.22189.objecter ms_handle_connect 0x7f382806c850 2023-11-01T03:41:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f384000ce30 con 0x7f38440a8770 2023-11-01T03:41:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 10 client.22189.objecter ms_dispatch 0x7f3844000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 3 client.22189.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 3 client.22189.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 10 client.22189.objecter checking command 1 2023-11-01T03:41:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f38280740b0 0x7f3828076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter _get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 15 client.22189.objecter _session_command_op_remove -1 1 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter _get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 15 client.22189.objecter _session_command_op_assign 1 1 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 4 2023-11-01T03:41:11.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 10 client.22189.objecter _send_command 1 2023-11-01T03:41:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3828076c20 con 0x7f38280740b0 2023-11-01T03:41:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f383a7fc640 20 client.22189.objecter dump_active .. 0 homeless 2023-11-01T03:41:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f384a142640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f38280740b0 0x7f3828076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.554+0000 7f384a142640 10 monclient: get_auth_request con 0x7f38280740b0 auth_method 0 2023-11-01T03:41:11.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.555+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3840054b30 con 0x7f38440a8770 2023-11-01T03:41:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.555+0000 7f383a7fc640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.557+0000 7f384a142640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f38280740b0 0x7f3828076550 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.557+0000 7f383a7fc640 10 client.22189.objecter ms_handle_connect 0x7f38280740b0 2023-11-01T03:41:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.581+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== osd.1 v2:172.21.15.5:6826/1708816016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3828076c20 con 0x7f38280740b0 2023-11-01T03:41:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.581+0000 7f383a7fc640 10 client.22189.objecter ms_dispatch 0x7f3844000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.581+0000 7f383a7fc640 10 client.22189.objecter _finish_command 1 = system:0 2023-11-01T03:41:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.581+0000 7f383a7fc640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 4 2023-11-01T03:41:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.581+0000 7f383a7fc640 15 client.22189.objecter _session_command_op_remove 1 1 2023-11-01T03:41:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 10 client.22189.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:11.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 15 client.22189.objecter _session_command_op_assign -1 2 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 20 client.22189.objecter _get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 20 client.22189.objecter _get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 15 client.22189.objecter _session_command_op_remove -1 2 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 20 client.22189.objecter get_session s=0x7f38280739e0 osd=1 3 2023-11-01T03:41:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 15 client.22189.objecter _session_command_op_assign 1 2 2023-11-01T03:41:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 4 2023-11-01T03:41:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 10 client.22189.objecter _send_command 2 2023-11-01T03:41:11.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.596+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 --> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f38440b1250 con 0x7f38280740b0 2023-11-01T03:41:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f383a7fc640 1 -- 172.21.15.5:0/2516213309 <== osd.1 v2:172.21.15.5:6826/1708816016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f38440b1250 con 0x7f38280740b0 2023-11-01T03:41:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f383a7fc640 10 client.22189.objecter ms_dispatch 0x7f3844000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f383a7fc640 10 client.22189.objecter _finish_command 2 = system:0 2023-11-01T03:41:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f383a7fc640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 4 2023-11-01T03:41:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f383a7fc640 15 client.22189.objecter _session_command_op_remove 1 2 2023-11-01T03:41:11.612 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:11.612 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:11.612 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.610+0000 7f384bba5640 10 librados: watch_flush enter 2023-11-01T03:41:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 10 librados: watch_flush exit 2023-11-01T03:41:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 10 client.22189.objecter close_session for osd.1 2023-11-01T03:41:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f38280740b0 msgr2=0x7f3828076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6826/1708816016,v1:172.21.15.5:6827/1708816016] conn(0x7f38280740b0 0x7f3828076550 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 20 client.22189.objecter put_session s=0x7f38280739e0 osd=1 1 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 20 client.22189.objecter shutdown clearing up homeless session... 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 10 client.22189.objecter successfully canceled tick 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f382806c850 msgr2=0x7f382806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f382806c850 0x7f382806ed10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38340011e0 tx=0x7f38340078f0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 10 monclient: shutdown 2023-11-01T03:41:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38440a8770 msgr2=0x7f38440ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 --2- 172.21.15.5:0/2516213309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38440a8770 0x7f38440ad440 secure :-1 s=READY pgs=5553 cs=0 l=1 rev1=1 crypto rx=0x7f384000e850 tx=0x7f384000ed10 comp rx=0 tx=0).stop 2023-11-01T03:41:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384a142640 1 -- 172.21.15.5:0/2516213309 reap_dead start 2023-11-01T03:41:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 shutdown_connections 2023-11-01T03:41:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 >> 172.21.15.5:0/2516213309 conn(0x7f3844065ee0 msgr2=0x7f384413e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 shutdown_connections 2023-11-01T03:41:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 -- 172.21.15.5:0/2516213309 wait complete. 2023-11-01T03:41:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.611+0000 7f384bba5640 1 librados: shutdown 2023-11-01T03:41:11.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-01T03:41:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.735+0000 7f044ed68640 10 monclient: get_monmap_and_config 2023-11-01T03:41:11.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.735+0000 7f044ed68640 10 monclient: build_initial_monmap 2023-11-01T03:41:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.735+0000 7f044ed68640 10 monclient: monmap: 2023-11-01T03:41:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:11.736718+0000 2023-11-01T03:41:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:11.736718+0000 2023-11-01T03:41:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:11.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.736+0000 7f044ed68640 1 Processor -- start 2023-11-01T03:41:11.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.736+0000 7f044ed68640 1 -- start start 2023-11-01T03:41:11.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.736+0000 7f044ed68640 10 monclient: init 2023-11-01T03:41:11.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2023-11-01T03:41:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f04480a8720 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0448141a80 0x7f04480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-a con 0x7f0448141a80 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f044813ebf0 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0448141fa0 con 0x7f044813ebf0 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04480aa500 con 0x7f04480a8720 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04480a8b00 con 0x7f0448141a80 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:11.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044ed68640 10 monclient(hunting): authenticate will time out at 2747.961178s 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f0447fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0448141a80 0x7f04480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044cb04640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f04480a8720 0x7f0448142430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50918/0 (socket says 172.21.15.5:50918) 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.737+0000 7f044cb04640 1 -- 172.21.15.5:0/2672259270 learned_addr learned my addr 172.21.15.5:0/2672259270 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.738+0000 7f0447fff640 10 monclient(hunting): get_auth_request con 0x7f0448141a80 auth_method 0 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.738+0000 7f0447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.738+0000 7f0447fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.738+0000 7f0447fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 1 -- 172.21.15.5:0/2672259270 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836857796 0 0) 0x7f04480aa500 con 0x7f04480a8720 2023-11-01T03:41:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 10 monclient(hunting): _negotiate 2023-11-01T03:41:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 10 monclient(hunting): my global_id is 22192 2023-11-01T03:41:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.739+0000 7f04477fe640 1 -- 172.21.15.5:0/2672259270 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0430003520 con 0x7f04480a8720 2023-11-01T03:41:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 10 monclient(hunting): handle_auth_done global_id 15405 payload 274 2023-11-01T03:41:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 1 -- 172.21.15.5:0/2672259270 >> v1:172.21.15.153:6789/0 conn(0x7f04480a8720 legacy=0x7f0448142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 1 -- 172.21.15.5:0/2672259270 >> v1:172.21.15.5:6789/0 conn(0x7f044813ebf0 legacy=0x7f044814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 1 monclient: found mon.noname-a 2023-11-01T03:41:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.741+0000 7f0447fff640 1 -- 172.21.15.5:0/2672259270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480aa770 con 0x7f0448141a80 2023-11-01T03:41:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.744+0000 7f0447fff640 1 --2- 172.21.15.5:0/2672259270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448141a80 0x7f04480b1c00 secure :-1 s=READY pgs=2992 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097a0 tx=0x7f043c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12bea812fbb7bc server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 1 -- 172.21.15.5:0/2672259270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c031830 con 0x7f0448141a80 2023-11-01T03:41:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: dump: 2023-11-01T03:41:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.752 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: _finish_auth 0 2023-11-01T03:41:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: _check_auth_tickets 2023-11-01T03:41:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 1 -- 172.21.15.5:0/2672259270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c031990 con 0x7f0448141a80 2023-11-01T03:41:11.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 1 -- 172.21.15.5:0/2672259270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c031d20 con 0x7f0448141a80 2023-11-01T03:41:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f044ed68640 5 monclient: authenticate success, global_id 15405 2023-11-01T03:41:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f044ed68640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f044ed68640 4 set_mon_vals no callback set 2023-11-01T03:41:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.749+0000 7f04477fe640 10 monclient: dump: 2023-11-01T03:41:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.755 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.756 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.757 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 10 monclient: shutdown 2023-11-01T03:41:11.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:11.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 -- 172.21.15.5:0/2672259270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448141a80 msgr2=0x7f04480b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 --2- 172.21.15.5:0/2672259270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448141a80 0x7f04480b1c00 secure :-1 s=READY pgs=2992 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097a0 tx=0x7f043c02b8d0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 -- 172.21.15.5:0/2672259270 shutdown_connections 2023-11-01T03:41:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 --2- 172.21.15.5:0/2672259270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448141a80 0x7f04480b1c00 unknown :-1 s=CLOSED pgs=2992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 -- 172.21.15.5:0/2672259270 >> 172.21.15.5:0/2672259270 conn(0x7f04480b7280 msgr2=0x7f04480b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:11.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 -- 172.21.15.5:0/2672259270 shutdown_connections 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.750+0000 7f044ed68640 1 -- 172.21.15.5:0/2672259270 wait complete. 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 10 monclient: build_initial_monmap 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 10 monclient: monmap: 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:11.762 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:11.763 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:11.764 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 librados: starting msgr at 2023-11-01T03:41:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 librados: starting objecter 2023-11-01T03:41:11.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 Processor -- start 2023-11-01T03:41:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 -- start start 2023-11-01T03:41:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 librados: setting wanted keys 2023-11-01T03:41:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 1 librados: calling monclient init 2023-11-01T03:41:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.751+0000 7f044ed68640 10 monclient: init 2023-11-01T03:41:11.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 0x7f04480b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-c con 0x7f04480a8720 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 0x7f0448144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-b con 0x7f044813ebf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448145710 0x7f0448136410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): picked mon.noname-a con 0x7f0448145710 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04481450b0 con 0x7f0448145710 2023-11-01T03:41:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448144c70 con 0x7f044813ebf0 2023-11-01T03:41:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448144e30 con 0x7f04480a8720 2023-11-01T03:41:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:11.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.752+0000 7f044ed68640 10 monclient(hunting): authenticate will time out at 2747.976505s 2023-11-01T03:41:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 0x7f04480b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448145710 0x7f0448136410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f0447fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 0x7f0448144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:11.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 0x7f04480b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47038/0 (socket says 172.21.15.5:47038) 2023-11-01T03:41:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 1 -- 172.21.15.5:0/827545175 learned_addr learned my addr 172.21.15.5:0/827545175 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): get_auth_request con 0x7f0448145710 auth_method 0 2023-11-01T03:41:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): get_auth_request con 0x7f04480a8720 auth_method 0 2023-11-01T03:41:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f0447fff640 10 monclient(hunting): get_auth_request con 0x7f044813ebf0 auth_method 0 2023-11-01T03:41:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f0447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f0447fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f0447fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044d305640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.753+0000 7f044cb04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.754+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.754+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.754+0000 7f0447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 10 monclient(hunting): handle_auth_done global_id 22195 payload 824 2023-11-01T03:41:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 -- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 msgr2=0x7f04480b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 0x7f04480b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 -- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448145710 msgr2=0x7f0448136410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448145710 0x7f0448136410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 monclient: found mon.noname-b 2023-11-01T03:41:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.756+0000 7f0447fff640 1 -- 172.21.15.5:0/827545175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c009400 con 0x7f044813ebf0 2023-11-01T03:41:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.759+0000 7f0447fff640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 0x7f0448144730 secure :-1 s=READY pgs=5555 cs=0 l=1 rev1=1 crypto rx=0x7f043c033000 tx=0x7f043c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.759+0000 7f04457fa640 10 client.?.objecter ms_handle_connect 0x7f044813ebf0 2023-11-01T03:41:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.759+0000 7f04457fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c03b9f0 con 0x7f044813ebf0 2023-11-01T03:41:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: dump: 2023-11-01T03:41:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.778 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.779 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.780 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: _finish_auth 0 2023-11-01T03:41:11.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: _check_auth_tickets 2023-11-01T03:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c03bb70 con 0x7f044813ebf0 2023-11-01T03:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0433f0 con 0x7f044813ebf0 2023-11-01T03:41:11.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04457fa640 10 monclient: dump: 2023-11-01T03:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:11.782 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:11.783 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 5 monclient: authenticate success, global_id 22195 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 10 monclient: _renew_subs 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0448136950 con 0x7f044813ebf0 2023-11-01T03:41:11.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.762+0000 7f04467fc640 4 set_mon_vals no callback set 2023-11-01T03:41:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 10 client.22195.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 10 monclient: _renew_subs 2023-11-01T03:41:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0448136d80 con 0x7f044813ebf0 2023-11-01T03:41:11.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.763+0000 7f044ed68640 1 librados: init done 2023-11-01T03:41:11.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.764+0000 7f044ed68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:11.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.764+0000 7f044ed68640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:11.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.764+0000 7f044ed68640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:11.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:11.764+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044804e9f0 con 0x7f044813ebf0 2023-11-01T03:41:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.003+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f043c04c3b0 con 0x7f044813ebf0 2023-11-01T03:41:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.003+0000 7f04457fa640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 0x7f043406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.003+0000 7f044cb04640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 0x7f043406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.004+0000 7f044cb04640 10 monclient: get_auth_request con 0x7f043406c880 auth_method 0 2023-11-01T03:41:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.004+0000 7f044cb04640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 0x7f043406ed40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f04380011e0 tx=0x7f0438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.004+0000 7f04457fa640 10 client.22195.objecter ms_handle_connect 0x7f043406c880 2023-11-01T03:41:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.005+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f043c07a680 con 0x7f044813ebf0 2023-11-01T03:41:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.005+0000 7f04457fa640 10 client.22195.objecter ms_dispatch 0x7f0448000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.005+0000 7f04457fa640 3 client.22195.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:12.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.005+0000 7f04457fa640 3 client.22195.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:12.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.005+0000 7f04457fa640 20 client.22195.objecter dump_active .. 0 homeless 2023-11-01T03:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.015+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f043c0769c0 con 0x7f044813ebf0 2023-11-01T03:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.015+0000 7f04457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.015+0000 7f04457fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.202+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f04480b2140 con 0x7f043406c880 2023-11-01T03:41:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.202+0000 7f04457fa640 1 -- 172.21.15.5:0/827545175 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f043800f820 con 0x7f043406c880 2023-11-01T03:41:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2023-11-01T03:41:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 10 librados: watch_flush enter 2023-11-01T03:41:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 10 librados: watch_flush exit 2023-11-01T03:41:12.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 20 client.22195.objecter shutdown clearing up homeless session... 2023-11-01T03:41:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 10 client.22195.objecter successfully canceled tick 2023-11-01T03:41:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 msgr2=0x7f043406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 0x7f043406ed40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f04380011e0 tx=0x7f0438009040 comp rx=0 tx=0).stop 2023-11-01T03:41:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 10 monclient: shutdown 2023-11-01T03:41:12.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 msgr2=0x7f0448144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 0x7f0448144730 secure :-1 s=READY pgs=5555 cs=0 l=1 rev1=1 crypto rx=0x7f043c033000 tx=0x7f043c0046c0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 shutdown_connections 2023-11-01T03:41:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f043406c880 0x7f043406ed40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0448145710 0x7f0448136410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044813ebf0 0x7f0448144730 unknown :-1 s=CLOSED pgs=5555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 --2- 172.21.15.5:0/827545175 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f04480a8720 0x7f04480b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 >> 172.21.15.5:0/827545175 conn(0x7f04480b7280 msgr2=0x7f044813a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 shutdown_connections 2023-11-01T03:41:12.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 -- 172.21.15.5:0/827545175 wait complete. 2023-11-01T03:41:12.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.205+0000 7f044ed68640 1 librados: shutdown 2023-11-01T03:41:12.217 INFO:tasks.ceph:Scrubbing osd.2 2023-11-01T03:41:12.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.328+0000 7f4c5ab1d640 10 monclient: get_monmap_and_config 2023-11-01T03:41:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.328+0000 7f4c5ab1d640 10 monclient: build_initial_monmap 2023-11-01T03:41:12.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.328+0000 7f4c5ab1d640 10 monclient: monmap: 2023-11-01T03:41:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:12.329638+0000 2023-11-01T03:41:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:12.329638+0000 2023-11-01T03:41:12.330 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:12.331 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:12.332 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.329+0000 7f4c5ab1d640 1 Processor -- start 2023-11-01T03:41:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.329+0000 7f4c5ab1d640 1 -- start start 2023-11-01T03:41:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.329+0000 7f4c5ab1d640 10 monclient: init 2023-11-01T03:41:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2023-11-01T03:41:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c540b42c0 0x7f4c540a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-c con 0x7f4c540b42c0 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-b con 0x7f4c540a8770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c5413f130 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540a8d00 con 0x7f4c5413f130 2023-11-01T03:41:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540b46a0 con 0x7f4c540b42c0 2023-11-01T03:41:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5413f5c0 con 0x7f4c540a8770 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c5ab1d640 10 monclient(hunting): authenticate will time out at 2748.554417s 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.330+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47052/0 (socket says 172.21.15.5:47052) 2023-11-01T03:41:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 1 -- 172.21.15.5:0/1998557715 learned_addr learned my addr 172.21.15.5:0/1998557715 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): get_auth_request con 0x7f4c540a8770 auth_method 0 2023-11-01T03:41:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.331+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.332+0000 7f4c588b9640 1 --2- 172.21.15.5:0/1998557715 >> v2:172.21.15.153:3300/0 conn(0x7f4c540b42c0 0x7f4c540a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c588b9640 10 monclient(hunting): get_auth_request con 0x7f4c540b42c0 auth_method 0 2023-11-01T03:41:12.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c588b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c588b9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c588b9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_done global_id 17372 payload 274 2023-11-01T03:41:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 1 -- 172.21.15.5:0/1998557715 >> v2:172.21.15.153:3300/0 conn(0x7f4c540b42c0 msgr2=0x7f4c540a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:12.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/1998557715 >> v2:172.21.15.153:3300/0 conn(0x7f4c540b42c0 0x7f4c540a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 1 -- 172.21.15.5:0/1998557715 >> v1:172.21.15.153:6789/0 conn(0x7f4c5413f130 legacy=0x7f4c54144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 1 monclient: found mon.noname-b 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.333+0000 7f4c4bfff640 1 -- 172.21.15.5:0/1998557715 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540ade80 con 0x7f4c540a8770 2023-11-01T03:41:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.335+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/1998557715 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 secure :-1 s=READY pgs=2895 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009870 tx=0x7f4c4402b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d796c9787c626e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 1 -- 172.21.15.5:0/1998557715 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44031740 con 0x7f4c540a8770 2023-11-01T03:41:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: dump: 2023-11-01T03:41:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: _finish_auth 0 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: _check_auth_tickets 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 5 monclient: authenticate success, global_id 17372 2023-11-01T03:41:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 1 -- 172.21.15.5:0/1998557715 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c440318a0 con 0x7f4c540a8770 2023-11-01T03:41:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 4 set_mon_vals no callback set 2023-11-01T03:41:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 1 -- 172.21.15.5:0/1998557715 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44031c30 con 0x7f4c540a8770 2023-11-01T03:41:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c4b7fe640 10 monclient: dump: 2023-11-01T03:41:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 10 monclient: shutdown 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:12.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/1998557715 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 msgr2=0x7f4c5413ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/1998557715 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 secure :-1 s=READY pgs=2895 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009870 tx=0x7f4c4402b7e0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/1998557715 shutdown_connections 2023-11-01T03:41:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/1998557715 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c5413ebf0 unknown :-1 s=CLOSED pgs=2895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/1998557715 >> v2:172.21.15.153:3300/0 conn(0x7f4c540b42c0 0x7f4c540a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/1998557715 >> 172.21.15.5:0/1998557715 conn(0x7f4c54065ee0 msgr2=0x7f4c540662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/1998557715 shutdown_connections 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.339+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/1998557715 wait complete. 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.340+0000 7f4c5ab1d640 10 monclient: build_initial_monmap 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.340+0000 7f4c5ab1d640 10 monclient: monmap: 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:12.354 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.355 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 librados: starting msgr at 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 librados: starting objecter 2023-11-01T03:41:12.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 Processor -- start 2023-11-01T03:41:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 -- start start 2023-11-01T03:41:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 librados: setting wanted keys 2023-11-01T03:41:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 librados: calling monclient init 2023-11-01T03:41:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 10 monclient: init 2023-11-01T03:41:12.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.341+0000 7f4c5ab1d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c540abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-c con 0x7f4c540a8770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c540b42c0 0x7f4c540b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-b con 0x7f4c540b42c0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c5413f130 0x7f4c540b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): picked mon.noname-a con 0x7f4c5413f130 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540ac930 con 0x7f4c5413f130 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c540b6dd0 con 0x7f4c540b42c0 2023-11-01T03:41:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5413fa70 con 0x7f4c540a8770 2023-11-01T03:41:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c5ab1d640 10 monclient(hunting): authenticate will time out at 2748.566037s 2023-11-01T03:41:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c540abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c540abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47064/0 (socket says 172.21.15.5:47064) 2023-11-01T03:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 1 -- 172.21.15.5:0/4034492859 learned_addr learned my addr 172.21.15.5:0/4034492859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 10 monclient(hunting): get_auth_request con 0x7f4c540a8770 auth_method 0 2023-11-01T03:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c590ba640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c5413f130 0x7f4c540b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c588b9640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c540b42c0 0x7f4c540b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c4bfff640 10 monclient(hunting): get_auth_request con 0x7f4c540b42c0 auth_method 0 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c4bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.342+0000 7f4c4bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): get_auth_request con 0x7f4c5413f130 auth_method 0 2023-11-01T03:41:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c588b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c588b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c588b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.343+0000 7f4c590ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 10 monclient(hunting): handle_auth_done global_id 17375 payload 824 2023-11-01T03:41:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 -- 172.21.15.5:0/4034492859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c540b42c0 msgr2=0x7f4c540b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c540b42c0 0x7f4c540b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 -- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c5413f130 msgr2=0x7f4c540b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c5413f130 0x7f4c540b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 10 monclient: _finish_hunting 0 2023-11-01T03:41:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 monclient: found mon.noname-c 2023-11-01T03:41:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c588b9640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440094d0 con 0x7f4c540a8770 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.346+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c540b42c0 0x7f4c540b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.348+0000 7f4c588b9640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c540abb20 secure :-1 s=READY pgs=2896 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d800 tx=0x7f4c5000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.348+0000 7f4c497fa640 10 client.?.objecter ms_handle_connect 0x7f4c540a8770 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.348+0000 7f4c497fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000b6c0 con 0x7f4c540a8770 2023-11-01T03:41:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 10 monclient: dump: 2023-11-01T03:41:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.372 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 10 monclient: _finish_auth 0 2023-11-01T03:41:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 10 monclient: _check_auth_tickets 2023-11-01T03:41:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 5 monclient: authenticate success, global_id 17375 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 10 monclient: _renew_subs 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540ac130 con 0x7f4c540a8770 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 10 client.17375.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 10 monclient: _renew_subs 2023-11-01T03:41:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c540acdc0 con 0x7f4c540a8770 2023-11-01T03:41:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.351+0000 7f4c5ab1d640 1 librados: init done 2023-11-01T03:41:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 10 client.17375.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 15 client.17375.objecter _session_command_op_assign -1 1 2023-11-01T03:41:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 20 client.17375.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 10 client.17375.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c540aca70 con 0x7f4c540a8770 2023-11-01T03:41:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000b820 con 0x7f4c540a8770 2023-11-01T03:41:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000bb90 con 0x7f4c540a8770 2023-11-01T03:41:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c497fa640 10 monclient: dump: 2023-11-01T03:41:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.377 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.378 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.352+0000 7f4c4affd640 4 set_mon_vals no callback set 2023-11-01T03:41:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.373+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c5000bcf0 con 0x7f4c540a8770 2023-11-01T03:41:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.373+0000 7f4c497fa640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f4c4006c800 0x7f4c4006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.373+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f4c4006c800 0x7f4c4006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.373+0000 7f4c4bfff640 10 monclient: get_auth_request con 0x7f4c4006c800 auth_method 0 2023-11-01T03:41:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.374+0000 7f4c497fa640 10 client.17375.objecter ms_handle_connect 0x7f4c4006c800 2023-11-01T03:41:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.374+0000 7f4c4bfff640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f4c4006c800 0x7f4c4006ecc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4c44035000 tx=0x7f4c44008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f4c50059380 con 0x7f4c540a8770 2023-11-01T03:41:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 10 client.17375.objecter ms_dispatch 0x7f4c54000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:12.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 3 client.17375.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 3 client.17375.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 10 client.17375.objecter checking command 1 2023-11-01T03:41:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f4c40074060 0x7f4c40076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter _get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 15 client.17375.objecter _session_command_op_remove -1 1 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter _get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 15 client.17375.objecter _session_command_op_assign 2 1 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 4 2023-11-01T03:41:12.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 10 client.17375.objecter _send_command 1 2023-11-01T03:41:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c40076bd0 con 0x7f4c40074060 2023-11-01T03:41:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 20 client.17375.objecter dump_active .. 0 homeless 2023-11-01T03:41:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c500556c0 con 0x7f4c540a8770 2023-11-01T03:41:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.375+0000 7f4c497fa640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:12.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.376+0000 7f4c590ba640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f4c40074060 0x7f4c40076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.376+0000 7f4c590ba640 10 monclient: get_auth_request con 0x7f4c40074060 auth_method 0 2023-11-01T03:41:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.379+0000 7f4c590ba640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f4c40074060 0x7f4c40076500 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.379+0000 7f4c497fa640 10 client.17375.objecter ms_handle_connect 0x7f4c40074060 2023-11-01T03:41:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.403+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== osd.2 v2:172.21.15.5:6818/4138368784 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4c40076bd0 con 0x7f4c40074060 2023-11-01T03:41:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.403+0000 7f4c497fa640 10 client.17375.objecter ms_dispatch 0x7f4c54000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:12.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.403+0000 7f4c497fa640 10 client.17375.objecter _finish_command 1 = system:0 2023-11-01T03:41:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.403+0000 7f4c497fa640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 4 2023-11-01T03:41:12.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.403+0000 7f4c497fa640 15 client.17375.objecter _session_command_op_remove 2 1 2023-11-01T03:41:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 10 client.17375.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 15 client.17375.objecter _session_command_op_assign -1 2 2023-11-01T03:41:12.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 20 client.17375.objecter _get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 20 client.17375.objecter _get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 15 client.17375.objecter _session_command_op_remove -1 2 2023-11-01T03:41:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 20 client.17375.objecter get_session s=0x7f4c40073990 osd=2 3 2023-11-01T03:41:12.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 15 client.17375.objecter _session_command_op_assign 2 2 2023-11-01T03:41:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 4 2023-11-01T03:41:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 10 client.17375.objecter _send_command 2 2023-11-01T03:41:12.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.417+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 --> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c54075530 con 0x7f4c40074060 2023-11-01T03:41:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c497fa640 1 -- 172.21.15.5:0/4034492859 <== osd.2 v2:172.21.15.5:6818/4138368784 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4c54075530 con 0x7f4c40074060 2023-11-01T03:41:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c497fa640 10 client.17375.objecter ms_dispatch 0x7f4c54000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c497fa640 10 client.17375.objecter _finish_command 2 = system:0 2023-11-01T03:41:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c497fa640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 4 2023-11-01T03:41:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c497fa640 15 client.17375.objecter _session_command_op_remove 2 2 2023-11-01T03:41:12.434 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:12.434 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 10 librados: watch_flush enter 2023-11-01T03:41:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 10 librados: watch_flush exit 2023-11-01T03:41:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 10 client.17375.objecter close_session for osd.2 2023-11-01T03:41:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f4c40074060 msgr2=0x7f4c40076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6818/4138368784,v1:172.21.15.5:6819/4138368784] conn(0x7f4c40074060 0x7f4c40076500 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 20 client.17375.objecter put_session s=0x7f4c40073990 osd=2 1 2023-11-01T03:41:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 20 client.17375.objecter shutdown clearing up homeless session... 2023-11-01T03:41:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 10 client.17375.objecter successfully canceled tick 2023-11-01T03:41:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f4c4006c800 msgr2=0x7f4c4006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f4c4006c800 0x7f4c4006ecc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4c44035000 tx=0x7f4c44008030 comp rx=0 tx=0).stop 2023-11-01T03:41:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 10 monclient: shutdown 2023-11-01T03:41:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 msgr2=0x7f4c540abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c5ab1d640 1 --2- 172.21.15.5:0/4034492859 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f4c540a8770 0x7f4c540abb20 secure :-1 s=READY pgs=2896 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d800 tx=0x7f4c5000dcc0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.432+0000 7f4c590ba640 1 -- 172.21.15.5:0/4034492859 reap_dead start 2023-11-01T03:41:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.433+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 shutdown_connections 2023-11-01T03:41:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.433+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 >> 172.21.15.5:0/4034492859 conn(0x7f4c54065ee0 msgr2=0x7f4c5413a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.433+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 shutdown_connections 2023-11-01T03:41:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.433+0000 7f4c5ab1d640 1 -- 172.21.15.5:0/4034492859 wait complete. 2023-11-01T03:41:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.433+0000 7f4c5ab1d640 1 librados: shutdown 2023-11-01T03:41:12.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-01T03:41:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 10 monclient: get_monmap_and_config 2023-11-01T03:41:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 10 monclient: build_initial_monmap 2023-11-01T03:41:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 10 monclient: monmap: 2023-11-01T03:41:12.551 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:12.551103+0000 2023-11-01T03:41:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:12.551103+0000 2023-11-01T03:41:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:12.553 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 1 Processor -- start 2023-11-01T03:41:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 1 -- start start 2023-11-01T03:41:12.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.550+0000 7f7460e61640 10 monclient: init 2023-11-01T03:41:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2023-11-01T03:41:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f745c0b4240 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f745c0b38d0 0x7f745c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-a con 0x7f745c0b38d0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-b con 0x7f745c0ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:12.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c0b0cc0 con 0x7f745c0b4240 2023-11-01T03:41:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c0b4620 con 0x7f745c0b38d0 2023-11-01T03:41:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0aeb80 con 0x7f745c0ade00 2023-11-01T03:41:12.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.551+0000 7f7460e61640 10 monclient(hunting): authenticate will time out at 2748.775562s 2023-11-01T03:41:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f7459d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f745c0b38d0 0x7f745c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47074/0 (socket says 172.21.15.5:47074) 2023-11-01T03:41:12.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 1 -- 172.21.15.5:0/2785645602 learned_addr learned my addr 172.21.15.5:0/2785645602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 10 monclient(hunting): get_auth_request con 0x7f745c0ade00 auth_method 0 2023-11-01T03:41:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f745ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f7459d9b640 10 monclient(hunting): get_auth_request con 0x7f745c0b38d0 auth_method 0 2023-11-01T03:41:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f7459d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f7459d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.552+0000 7f7459d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f745ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f745ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f745ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.553+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 10 monclient(hunting): handle_auth_done global_id 17378 payload 274 2023-11-01T03:41:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 1 -- 172.21.15.5:0/2785645602 >> v2:172.21.15.5:3300/0 conn(0x7f745c0b38d0 msgr2=0x7f745c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 1 --2- 172.21.15.5:0/2785645602 >> v2:172.21.15.5:3300/0 conn(0x7f745c0b38d0 0x7f745c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 1 -- 172.21.15.5:0/2785645602 >> v1:172.21.15.5:6789/0 conn(0x7f745c0b4240 legacy=0x7f745c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 10 monclient: _finish_hunting 0 2023-11-01T03:41:12.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 1 monclient: found mon.noname-b 2023-11-01T03:41:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:12.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.554+0000 7f745ad9d640 1 -- 172.21.15.5:0/2785645602 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c13f5f0 con 0x7f745c0ade00 2023-11-01T03:41:12.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.556+0000 7f745ad9d640 1 --2- 172.21.15.5:0/2785645602 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 secure :-1 s=READY pgs=2897 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e80 tx=0x7f744c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34cbdf919656ce03 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 1 -- 172.21.15.5:0/2785645602 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c02ca50 con 0x7f745c0ade00 2023-11-01T03:41:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: dump: 2023-11-01T03:41:12.568 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.569 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: _finish_auth 0 2023-11-01T03:41:12.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: _check_auth_tickets 2023-11-01T03:41:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 5 monclient: authenticate success, global_id 17378 2023-11-01T03:41:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 1 -- 172.21.15.5:0/2785645602 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c02cbb0 con 0x7f745c0ade00 2023-11-01T03:41:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 1 -- 172.21.15.5:0/2785645602 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0343f0 con 0x7f745c0ade00 2023-11-01T03:41:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 4 set_mon_vals no callback set 2023-11-01T03:41:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f745959a640 10 monclient: dump: 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.574 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.574 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 10 monclient: shutdown 2023-11-01T03:41:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 1 -- 172.21.15.5:0/2785645602 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 msgr2=0x7f745c13b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.561+0000 7f7460e61640 1 --2- 172.21.15.5:0/2785645602 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 secure :-1 s=READY pgs=2897 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e80 tx=0x7f744c02beb0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 -- 172.21.15.5:0/2785645602 shutdown_connections 2023-11-01T03:41:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 --2- 172.21.15.5:0/2785645602 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c0ade00 0x7f745c13b420 unknown :-1 s=CLOSED pgs=2897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 --2- 172.21.15.5:0/2785645602 >> v2:172.21.15.5:3300/0 conn(0x7f745c0b38d0 0x7f745c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 -- 172.21.15.5:0/2785645602 >> 172.21.15.5:0/2785645602 conn(0x7f745c065cd0 msgr2=0x7f745c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 -- 172.21.15.5:0/2785645602 shutdown_connections 2023-11-01T03:41:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 1 -- 172.21.15.5:0/2785645602 wait complete. 2023-11-01T03:41:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 10 monclient: build_initial_monmap 2023-11-01T03:41:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.562+0000 7f7460e61640 10 monclient: monmap: 2023-11-01T03:41:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:12.579 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 librados: starting msgr at 2023-11-01T03:41:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 librados: starting objecter 2023-11-01T03:41:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 Processor -- start 2023-11-01T03:41:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 -- start start 2023-11-01T03:41:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 librados: setting wanted keys 2023-11-01T03:41:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 1 librados: calling monclient init 2023-11-01T03:41:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.563+0000 7f7460e61640 10 monclient: init 2023-11-01T03:41:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745c0ade00 0x7f745c141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-b con 0x7f745c0ade00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-a con 0x7f745c0b4240 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): picked mon.noname-c con 0x7f745c1d9ea0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c142170 con 0x7f745c0b4240 2023-11-01T03:41:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c13e500 con 0x7f745c0ade00 2023-11-01T03:41:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c141d10 con 0x7f745c1d9ea0 2023-11-01T03:41:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7460e61640 10 monclient(hunting): authenticate will time out at 2748.788128s 2023-11-01T03:41:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.564+0000 7f7459d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f745ad9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55652/0 (socket says 172.21.15.5:55652) 2023-11-01T03:41:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 1 -- 172.21.15.5:0/2762324243 learned_addr learned my addr 172.21.15.5:0/2762324243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): get_auth_request con 0x7f745c0b4240 auth_method 0 2023-11-01T03:41:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f745ad9d640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 msgr2=0x7f745c1da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f745ad9d640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 msgr2=0x7f745c1da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f745ad9d640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f745ad9d640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-01T03:41:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.565+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f7459d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f745a59c640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745c0ade00 0x7f745c141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f745a59c640 10 monclient(hunting): get_auth_request con 0x7f745c0ade00 auth_method 0 2023-11-01T03:41:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f745a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f745a59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.566+0000 7f745a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.567+0000 7f745a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.567+0000 7f745a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.567+0000 7f745a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 10 monclient(hunting): handle_auth_done global_id 15423 payload 824 2023-11-01T03:41:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 msgr2=0x7f745c1da350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-01T03:41:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745c0ade00 msgr2=0x7f745c141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745c0ade00 0x7f745c141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 10 monclient: _finish_hunting 0 2023-11-01T03:41:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 monclient: found mon.noname-a 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.568+0000 7f7459d9b640 1 -- 172.21.15.5:0/2762324243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c009b30 con 0x7f745c0b4240 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.572+0000 7f7459d9b640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 crypto rx=0x7f745000e9b0 tx=0x7f745000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.572+0000 7f744affd640 10 client.?.objecter ms_handle_connect 0x7f745c0b4240 2023-11-01T03:41:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.572+0000 7f744affd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7450009670 con 0x7f745c0b4240 2023-11-01T03:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: dump: 2023-11-01T03:41:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: _finish_auth 0 2023-11-01T03:41:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745000c9a0 con 0x7f745c0b4240 2023-11-01T03:41:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745000cd50 con 0x7f745c0b4240 2023-11-01T03:41:12.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f744affd640 10 monclient: dump: 2023-11-01T03:41:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:12.596 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:12.598 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 5 monclient: authenticate success, global_id 15423 2023-11-01T03:41:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 10 monclient: _renew_subs 2023-11-01T03:41:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c1da890 con 0x7f745c0b4240 2023-11-01T03:41:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7458d99640 4 set_mon_vals no callback set 2023-11-01T03:41:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 10 client.15423.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 10 monclient: _renew_subs 2023-11-01T03:41:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c1d6b60 con 0x7f745c0b4240 2023-11-01T03:41:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.577+0000 7f7460e61640 1 librados: init done 2023-11-01T03:41:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.578+0000 7f7460e61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.578+0000 7f7460e61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.578+0000 7f7460e61640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.578+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c13e6c0 con 0x7f745c0b4240 2023-11-01T03:41:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.599+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7450013470 con 0x7f745c0b4240 2023-11-01T03:41:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.599+0000 7f744affd640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 0x7f743c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.600+0000 7f745a59c640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 0x7f743c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.600+0000 7f745a59c640 10 monclient: get_auth_request con 0x7f743c06c850 auth_method 0 2023-11-01T03:41:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.600+0000 7f745a59c640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 0x7f743c06ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7454000f60 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.600+0000 7f744affd640 10 client.15423.objecter ms_handle_connect 0x7f743c06c850 2023-11-01T03:41:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.602+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f7450058db0 con 0x7f745c0b4240 2023-11-01T03:41:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.602+0000 7f744affd640 10 client.15423.objecter ms_dispatch 0x7f745c000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.602+0000 7f744affd640 3 client.15423.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.602+0000 7f744affd640 3 client.15423.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.602+0000 7f744affd640 20 client.15423.objecter dump_active .. 0 homeless 2023-11-01T03:41:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.867+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74500550f0 con 0x7f745c0b4240 2023-11-01T03:41:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.867+0000 7f744affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:12.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:12.867+0000 7f744affd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.056+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f745c04e9f0 con 0x7f743c06c850 2023-11-01T03:41:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.057+0000 7f744affd640 1 -- 172.21.15.5:0/2762324243 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f745c04e9f0 con 0x7f743c06c850 2023-11-01T03:41:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2023-11-01T03:41:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.058+0000 7f7460e61640 10 librados: watch_flush enter 2023-11-01T03:41:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.058+0000 7f7460e61640 10 librados: watch_flush exit 2023-11-01T03:41:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.058+0000 7f7460e61640 20 client.15423.objecter shutdown clearing up homeless session... 2023-11-01T03:41:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.058+0000 7f7460e61640 10 client.15423.objecter successfully canceled tick 2023-11-01T03:41:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 msgr2=0x7f743c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 0x7f743c06ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7454000f60 tx=0x7f7454009040 comp rx=0 tx=0).stop 2023-11-01T03:41:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 10 monclient: shutdown 2023-11-01T03:41:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 msgr2=0x7f745c1417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 secure :-1 s=READY pgs=2994 cs=0 l=1 rev1=1 crypto rx=0x7f745000e9b0 tx=0x7f745000ee70 comp rx=0 tx=0).stop 2023-11-01T03:41:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 shutdown_connections 2023-11-01T03:41:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f743c06c850 0x7f743c06ed10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f745c1d9ea0 0x7f745c1da350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f745c0b4240 0x7f745c1417d0 unknown :-1 s=CLOSED pgs=2994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 --2- 172.21.15.5:0/2762324243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745c0ade00 0x7f745c141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 >> 172.21.15.5:0/2762324243 conn(0x7f745c065cd0 msgr2=0x7f745c0b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 shutdown_connections 2023-11-01T03:41:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 -- 172.21.15.5:0/2762324243 wait complete. 2023-11-01T03:41:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.059+0000 7f7460e61640 1 librados: shutdown 2023-11-01T03:41:13.071 INFO:tasks.ceph:Scrubbing osd.3 2023-11-01T03:41:13.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.185+0000 7f25bef97640 10 monclient: get_monmap_and_config 2023-11-01T03:41:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.185+0000 7f25bef97640 10 monclient: build_initial_monmap 2023-11-01T03:41:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.185+0000 7f25bef97640 10 monclient: monmap: 2023-11-01T03:41:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:13.186352+0000 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:13.186352+0000 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:13.188 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 Processor -- start 2023-11-01T03:41:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 -- start start 2023-11-01T03:41:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient: init 2023-11-01T03:41:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2023-11-01T03:41:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-b con 0x7f25b806bba0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f25b8071840 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b8144f30 0x7f25b81453c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-a con 0x7f25b8144f30 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b806b110 con 0x7f25b8071840 2023-11-01T03:41:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80af180 con 0x7f25b8144f30 2023-11-01T03:41:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80af2c0 con 0x7f25b806bba0 2023-11-01T03:41:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.186+0000 7f25bef97640 10 monclient(hunting): authenticate will time out at 2749.410953s 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bd534640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b8144f30 0x7f25b81453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47092/0 (socket says 172.21.15.5:47092) 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 1 -- 172.21.15.5:0/3136208052 learned_addr learned my addr 172.21.15.5:0/3136208052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 10 monclient(hunting): get_auth_request con 0x7f25b806bba0 auth_method 0 2023-11-01T03:41:13.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.187+0000 7f25bcd33640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bd534640 10 monclient(hunting): get_auth_request con 0x7f25b8144f30 auth_method 0 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bd534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bd534640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bd534640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.188+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.189+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.189+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.189+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 10 monclient(hunting): handle_auth_done global_id 17381 payload 274 2023-11-01T03:41:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 1 -- 172.21.15.5:0/3136208052 >> v2:172.21.15.5:3300/0 conn(0x7f25b8144f30 msgr2=0x7f25b81453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 1 --2- 172.21.15.5:0/3136208052 >> v2:172.21.15.5:3300/0 conn(0x7f25b8144f30 0x7f25b81453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 1 -- 172.21.15.5:0/3136208052 >> v1:172.21.15.5:6789/0 conn(0x7f25b8071840 legacy=0x7f25b806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 10 monclient: _finish_hunting 0 2023-11-01T03:41:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 1 monclient: found mon.noname-b 2023-11-01T03:41:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.190+0000 7f25bcd33640 1 -- 172.21.15.5:0/3136208052 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80abc00 con 0x7f25b806bba0 2023-11-01T03:41:13.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.192+0000 7f25bcd33640 1 --2- 172.21.15.5:0/3136208052 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 secure :-1 s=READY pgs=2898 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009870 tx=0x7f25a002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40dd3f18773ece11 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 1 -- 172.21.15.5:0/3136208052 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00317c0 con 0x7f25b806bba0 2023-11-01T03:41:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: dump: 2023-11-01T03:41:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: _finish_auth 0 2023-11-01T03:41:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: _check_auth_tickets 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 1 -- 172.21.15.5:0/3136208052 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0031920 con 0x7f25b806bba0 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 1 -- 172.21.15.5:0/3136208052 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0031cb0 con 0x7f25b806bba0 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 5 monclient: authenticate success, global_id 17381 2023-11-01T03:41:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 4 set_mon_vals no callback set 2023-11-01T03:41:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25b77fe640 10 monclient: dump: 2023-11-01T03:41:13.206 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.208 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 10 monclient: shutdown 2023-11-01T03:41:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 -- 172.21.15.5:0/3136208052 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 msgr2=0x7f25b8071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 --2- 172.21.15.5:0/3136208052 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 secure :-1 s=READY pgs=2898 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009870 tx=0x7f25a002b860 comp rx=0 tx=0).stop 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 -- 172.21.15.5:0/3136208052 shutdown_connections 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 --2- 172.21.15.5:0/3136208052 >> v2:172.21.15.5:3300/0 conn(0x7f25b8144f30 0x7f25b81453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 --2- 172.21.15.5:0/3136208052 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b8071300 unknown :-1 s=CLOSED pgs=2898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.196+0000 7f25bef97640 1 -- 172.21.15.5:0/3136208052 >> 172.21.15.5:0/3136208052 conn(0x7f25b8066470 msgr2=0x7f25b80b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.197+0000 7f25bef97640 1 -- 172.21.15.5:0/3136208052 shutdown_connections 2023-11-01T03:41:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.197+0000 7f25bef97640 1 -- 172.21.15.5:0/3136208052 wait complete. 2023-11-01T03:41:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.197+0000 7f25bef97640 10 monclient: build_initial_monmap 2023-11-01T03:41:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.197+0000 7f25bef97640 10 monclient: monmap: 2023-11-01T03:41:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:13.212 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:13.212 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:13.212 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 librados: starting msgr at 2023-11-01T03:41:13.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 librados: starting objecter 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 Processor -- start 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 -- start start 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 librados: setting wanted keys 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 1 librados: calling monclient init 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.198+0000 7f25bef97640 10 monclient: init 2023-11-01T03:41:13.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-c con 0x7f25b806bba0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8071840 0x7f25b81d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-b con 0x7f25b8071840 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:13.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b8144f30 0x7f25b81da480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): picked mon.noname-a con 0x7f25b8144f30 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:13.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81d9a20 con 0x7f25b8144f30 2023-11-01T03:41:13.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81423e0 con 0x7f25b8071840 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8142550 con 0x7f25b806bba0 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bef97640 10 monclient(hunting): authenticate will time out at 2749.423118s 2023-11-01T03:41:13.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bd534640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b8144f30 0x7f25b81da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b813fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47106/0 (socket says 172.21.15.5:47106) 2023-11-01T03:41:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 1 -- 172.21.15.5:0/50772988 learned_addr learned my addr 172.21.15.5:0/50772988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 10 monclient(hunting): get_auth_request con 0x7f25b806bba0 auth_method 0 2023-11-01T03:41:13.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.199+0000 7f25bcd33640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): get_auth_request con 0x7f25b8144f30 auth_method 0 2023-11-01T03:41:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bcd33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.200+0000 7f25bd534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 10 monclient(hunting): handle_auth_done global_id 17384 payload 824 2023-11-01T03:41:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 -- 172.21.15.5:0/50772988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8071840 msgr2=0x7f25b81d9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8071840 0x7f25b81d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 -- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b8144f30 msgr2=0x7f25b81da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b8144f30 0x7f25b81da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 10 monclient: _finish_hunting 0 2023-11-01T03:41:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 monclient: found mon.noname-c 2023-11-01T03:41:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:41:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.203+0000 7f25bcd33640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00094d0 con 0x7f25b806bba0 2023-11-01T03:41:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.205+0000 7f25bcd33640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b813fa80 secure :-1 s=READY pgs=2899 cs=0 l=1 rev1=1 crypto rx=0x7f25a002b8a0 tx=0x7f25a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.205+0000 7f25b57fa640 10 client.?.objecter ms_handle_connect 0x7f25b806bba0 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.205+0000 7f25b57fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0032860 con 0x7f25b806bba0 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:13.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: dump: 2023-11-01T03:41:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.225 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.226 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: _finish_auth 0 2023-11-01T03:41:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: _check_auth_tickets 2023-11-01T03:41:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00329c0 con 0x7f25b806bba0 2023-11-01T03:41:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0032d70 con 0x7f25b806bba0 2023-11-01T03:41:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 5 monclient: authenticate success, global_id 17384 2023-11-01T03:41:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 10 monclient: _renew_subs 2023-11-01T03:41:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:13.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b81d6920 con 0x7f25b806bba0 2023-11-01T03:41:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b6ffd640 4 set_mon_vals no callback set 2023-11-01T03:41:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25b57fa640 10 monclient: dump: 2023-11-01T03:41:13.229 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.230 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.231 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 10 client.17384.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:13.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 10 monclient: _renew_subs 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b81d6dd0 con 0x7f25b806bba0 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.209+0000 7f25bef97640 1 librados: init done 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 10 client.17384.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 15 client.17384.objecter _session_command_op_assign -1 1 2023-11-01T03:41:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 20 client.17384.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 10 client.17384.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.210+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25b8145900 con 0x7f25b806bba0 2023-11-01T03:41:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.229+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25a004e450 con 0x7f25b806bba0 2023-11-01T03:41:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.229+0000 7f25b57fa640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f259806c850 0x7f259806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.229+0000 7f25b7fff640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f259806c850 0x7f259806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.229+0000 7f25b7fff640 10 monclient: get_auth_request con 0x7f259806c850 auth_method 0 2023-11-01T03:41:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.230+0000 7f25b57fa640 10 client.17384.objecter ms_handle_connect 0x7f259806c850 2023-11-01T03:41:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.230+0000 7f25b7fff640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f259806c850 0x7f259806ed10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000f60 tx=0x7f25a80079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f25a007b010 con 0x7f25b806bba0 2023-11-01T03:41:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 10 client.17384.objecter ms_dispatch 0x7f25b8000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 3 client.17384.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 3 client.17384.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 10 client.17384.objecter checking command 1 2023-11-01T03:41:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7f25980740b0 0x7f2598076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter _get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 15 client.17384.objecter _session_command_op_remove -1 1 2023-11-01T03:41:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter _get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 15 client.17384.objecter _session_command_op_assign 3 1 2023-11-01T03:41:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 4 2023-11-01T03:41:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 10 client.17384.objecter _send_command 1 2023-11-01T03:41:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2598076c20 con 0x7f25980740b0 2023-11-01T03:41:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25b57fa640 20 client.17384.objecter dump_active .. 0 homeless 2023-11-01T03:41:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.232+0000 7f25bd534640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7f25980740b0 0x7f2598076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.233+0000 7f25bd534640 10 monclient: get_auth_request con 0x7f25980740b0 auth_method 0 2023-11-01T03:41:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.234+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a0076c50 con 0x7f25b806bba0 2023-11-01T03:41:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.234+0000 7f25b57fa640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.235+0000 7f25bd534640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7f25980740b0 0x7f2598076550 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.235+0000 7f25b57fa640 10 client.17384.objecter ms_handle_connect 0x7f25980740b0 2023-11-01T03:41:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.260+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== osd.3 v2:172.21.15.5:6810/3809490384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2598076c20 con 0x7f25980740b0 2023-11-01T03:41:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.260+0000 7f25b57fa640 10 client.17384.objecter ms_dispatch 0x7f25b8000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.260+0000 7f25b57fa640 10 client.17384.objecter _finish_command 1 = system:0 2023-11-01T03:41:13.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.260+0000 7f25b57fa640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 4 2023-11-01T03:41:13.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.260+0000 7f25b57fa640 15 client.17384.objecter _session_command_op_remove 3 1 2023-11-01T03:41:13.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 10 client.17384.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:13.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 15 client.17384.objecter _session_command_op_assign -1 2 2023-11-01T03:41:13.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 20 client.17384.objecter _get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 20 client.17384.objecter _get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 15 client.17384.objecter _session_command_op_remove -1 2 2023-11-01T03:41:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 20 client.17384.objecter get_session s=0x7f25980739e0 osd=3 3 2023-11-01T03:41:13.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 15 client.17384.objecter _session_command_op_assign 3 2 2023-11-01T03:41:13.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 4 2023-11-01T03:41:13.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 10 client.17384.objecter _send_command 2 2023-11-01T03:41:13.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.272+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 --> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25b8075530 con 0x7f25980740b0 2023-11-01T03:41:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25b57fa640 1 -- 172.21.15.5:0/50772988 <== osd.3 v2:172.21.15.5:6810/3809490384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f25b8075530 con 0x7f25980740b0 2023-11-01T03:41:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25b57fa640 10 client.17384.objecter ms_dispatch 0x7f25b8000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25b57fa640 10 client.17384.objecter _finish_command 2 = system:0 2023-11-01T03:41:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25b57fa640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 4 2023-11-01T03:41:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25b57fa640 15 client.17384.objecter _session_command_op_remove 3 2 2023-11-01T03:41:13.289 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:13.289 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:13.289 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:13.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 10 librados: watch_flush enter 2023-11-01T03:41:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 10 librados: watch_flush exit 2023-11-01T03:41:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 10 client.17384.objecter close_session for osd.3 2023-11-01T03:41:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7f25980740b0 msgr2=0x7f2598076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6810/3809490384,v1:172.21.15.5:6811/3809490384] conn(0x7f25980740b0 0x7f2598076550 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 20 client.17384.objecter put_session s=0x7f25980739e0 osd=3 1 2023-11-01T03:41:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 20 client.17384.objecter shutdown clearing up homeless session... 2023-11-01T03:41:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 10 client.17384.objecter successfully canceled tick 2023-11-01T03:41:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f259806c850 msgr2=0x7f259806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f259806c850 0x7f259806ed10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f25a8000f60 tx=0x7f25a80079b0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 10 monclient: shutdown 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 msgr2=0x7f25b813fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 --2- 172.21.15.5:0/50772988 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f25b806bba0 0x7f25b813fa80 secure :-1 s=READY pgs=2899 cs=0 l=1 rev1=1 crypto rx=0x7f25a002b8a0 tx=0x7f25a00046c0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bd534640 1 -- 172.21.15.5:0/50772988 reap_dead start 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 shutdown_connections 2023-11-01T03:41:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 >> 172.21.15.5:0/50772988 conn(0x7f25b8066470 msgr2=0x7f25b80afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 shutdown_connections 2023-11-01T03:41:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 -- 172.21.15.5:0/50772988 wait complete. 2023-11-01T03:41:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.287+0000 7f25bef97640 1 librados: shutdown 2023-11-01T03:41:13.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-01T03:41:13.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.406+0000 7f85421b6640 10 monclient: get_monmap_and_config 2023-11-01T03:41:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.406+0000 7f85421b6640 10 monclient: build_initial_monmap 2023-11-01T03:41:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.406+0000 7f85421b6640 10 monclient: monmap: 2023-11-01T03:41:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:13.407292+0000 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:13.407292+0000 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:13.409 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:13.409 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:13.409 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:13.409 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 Processor -- start 2023-11-01T03:41:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 -- start start 2023-11-01T03:41:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient: init 2023-11-01T03:41:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2023-11-01T03:41:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f853c06a040 0x7f853c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-c con 0x7f853c06a040 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f853c13e820 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f853c141c00 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c06e2c0 con 0x7f853c141c00 2023-11-01T03:41:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0af950 con 0x7f853c13e820 2023-11-01T03:41:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c13f390 con 0x7f853c06a040 2023-11-01T03:41:13.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.407+0000 7f85421b6640 10 monclient(hunting): authenticate will time out at 2749.631716s 2023-11-01T03:41:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.408+0000 7f853bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f853c141c00 0x7f853c142070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47964/0 (socket says 172.21.15.5:47964) 2023-11-01T03:41:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.408+0000 7f853bfff640 1 -- 172.21.15.5:0/3818740169 learned_addr learned my addr 172.21.15.5:0/3818740169 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.408+0000 7f853b7fe640 1 --2- 172.21.15.5:0/3818740169 >> v2:172.21.15.153:3300/0 conn(0x7f853c06a040 0x7f853c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): get_auth_request con 0x7f853c06a040 auth_method 0 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.409+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 1 -- 172.21.15.5:0/3818740169 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740012141 0 0) 0x7f853c06e2c0 con 0x7f853c141c00 2023-11-01T03:41:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 10 monclient(hunting): _negotiate 2023-11-01T03:41:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 10 monclient(hunting): my global_id is 15432 2023-11-01T03:41:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.411+0000 7f853a7fc640 1 -- 172.21.15.5:0/3818740169 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8524003520 con 0x7f853c141c00 2023-11-01T03:41:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 10 monclient(hunting): handle_auth_done global_id 22207 payload 274 2023-11-01T03:41:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 1 -- 172.21.15.5:0/3818740169 >> v1:172.21.15.153:6789/0 conn(0x7f853c13e820 legacy=0x7f853c13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 1 -- 172.21.15.5:0/3818740169 >> v1:172.21.15.5:6789/0 conn(0x7f853c141c00 legacy=0x7f853c142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:41:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 1 monclient: found mon.noname-c 2023-11-01T03:41:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:41:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.412+0000 7f853b7fe640 1 -- 172.21.15.5:0/3818740169 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0ae1f0 con 0x7f853c06a040 2023-11-01T03:41:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.416+0000 7f853b7fe640 1 --2- 172.21.15.5:0/3818740169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c06a040 0x7f853c0af1a0 secure :-1 s=READY pgs=5558 cs=0 l=1 rev1=1 crypto rx=0x7f852c0097a0 tx=0x7f852c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2f827f0f82f478e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 1 -- 172.21.15.5:0/3818740169 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c031830 con 0x7f853c06a040 2023-11-01T03:41:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: dump: 2023-11-01T03:41:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.423 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 1 -- 172.21.15.5:0/3818740169 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c031990 con 0x7f853c06a040 2023-11-01T03:41:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f85421b6640 5 monclient: authenticate success, global_id 22207 2023-11-01T03:41:13.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f85421b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f85421b6640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 1 -- 172.21.15.5:0/3818740169 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c031d20 con 0x7f853c06a040 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f85421b6640 4 set_mon_vals no callback set 2023-11-01T03:41:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.420+0000 7f853a7fc640 10 monclient: dump: 2023-11-01T03:41:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 10 monclient: shutdown 2023-11-01T03:41:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 -- 172.21.15.5:0/3818740169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c06a040 msgr2=0x7f853c0af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 --2- 172.21.15.5:0/3818740169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c06a040 0x7f853c0af1a0 secure :-1 s=READY pgs=5558 cs=0 l=1 rev1=1 crypto rx=0x7f852c0097a0 tx=0x7f852c02b8d0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 -- 172.21.15.5:0/3818740169 shutdown_connections 2023-11-01T03:41:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 --2- 172.21.15.5:0/3818740169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c06a040 0x7f853c0af1a0 unknown :-1 s=CLOSED pgs=5558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 -- 172.21.15.5:0/3818740169 >> 172.21.15.5:0/3818740169 conn(0x7f853c0b09a0 msgr2=0x7f853c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 -- 172.21.15.5:0/3818740169 shutdown_connections 2023-11-01T03:41:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 1 -- 172.21.15.5:0/3818740169 wait complete. 2023-11-01T03:41:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 10 monclient: build_initial_monmap 2023-11-01T03:41:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.421+0000 7f85421b6640 10 monclient: monmap: 2023-11-01T03:41:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 librados: starting msgr at 2023-11-01T03:41:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 librados: starting objecter 2023-11-01T03:41:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 Processor -- start 2023-11-01T03:41:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 -- start start 2023-11-01T03:41:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 librados: setting wanted keys 2023-11-01T03:41:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 1 librados: calling monclient init 2023-11-01T03:41:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.422+0000 7f85421b6640 10 monclient: init 2023-11-01T03:41:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:41:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c06a040 0x7f853c145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-a con 0x7f853c06a040 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-b con 0x7f853c13e820 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f853c141c00 0x7f853c133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): picked mon.noname-c con 0x7f853c141c00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c144ba0 con 0x7f853c06a040 2023-11-01T03:41:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c144080 con 0x7f853c13e820 2023-11-01T03:41:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c133af0 con 0x7f853c141c00 2023-11-01T03:41:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f85421b6640 10 monclient(hunting): authenticate will time out at 2749.647102s 2023-11-01T03:41:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f853b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c06a040 0x7f853c145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f853bfff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f853c141c00 0x7f853c133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.423+0000 7f853affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:55390/0 (socket says 172.21.15.5:55390) 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 1 -- 172.21.15.5:0/473106582 learned_addr learned my addr 172.21.15.5:0/473106582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): get_auth_request con 0x7f853c13e820 auth_method 0 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): get_auth_request con 0x7f853c141c00 auth_method 0 2023-11-01T03:41:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): get_auth_request con 0x7f853c06a040 auth_method 0 2023-11-01T03:41:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.424+0000 7f853b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 10 monclient(hunting): handle_auth_done global_id 22213 payload 824 2023-11-01T03:41:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 -- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f853c141c00 msgr2=0x7f853c133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f853c141c00 0x7f853c133560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 -- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c06a040 msgr2=0x7f853c145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c06a040 0x7f853c145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 10 monclient: _finish_hunting 0 2023-11-01T03:41:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 monclient: found mon.noname-b 2023-11-01T03:41:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.427+0000 7f853affd640 1 -- 172.21.15.5:0/473106582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c009400 con 0x7f853c13e820 2023-11-01T03:41:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.429+0000 7f853affd640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 secure :-1 s=READY pgs=5559 cs=0 l=1 rev1=1 crypto rx=0x7f853000c450 tx=0x7f853000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.429+0000 7f8523fff640 10 client.?.objecter ms_handle_connect 0x7f853c13e820 2023-11-01T03:41:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.429+0000 7f8523fff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300052d0 con 0x7f853c13e820 2023-11-01T03:41:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:13.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: dump: 2023-11-01T03:41:13.449 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.449 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.449 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.449 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.450 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.450 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.450 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.450 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.450 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.451 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:13.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:13.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:13.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530005430 con 0x7f853c13e820 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 5 monclient: authenticate success, global_id 22213 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 10 monclient: _renew_subs 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c145070 con 0x7f853c13e820 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:13.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530012870 con 0x7f853c13e820 2023-11-01T03:41:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f8523fff640 10 monclient: dump: 2023-11-01T03:41:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:13.453 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:13.454 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85397fa640 4 set_mon_vals no callback set 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 10 client.22213.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:13.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 10 monclient: _renew_subs 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c06e770 con 0x7f853c13e820 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.432+0000 7f85421b6640 1 librados: init done 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.433+0000 7f85421b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.433+0000 7f85421b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:13.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.433+0000 7f85421b6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:13.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.433+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c04e9f0 con 0x7f853c13e820 2023-11-01T03:41:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.451+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f85300129d0 con 0x7f853c13e820 2023-11-01T03:41:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.451+0000 7f8523fff640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 0x7f852806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.451+0000 7f853b7fe640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 0x7f852806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:13.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.451+0000 7f853b7fe640 10 monclient: get_auth_request con 0x7f852806c850 auth_method 0 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f8523fff640 10 client.22213.objecter ms_handle_connect 0x7f852806c850 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f853b7fe640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 0x7f852806ed10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f852c036000 tx=0x7f852c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f85300588f0 con 0x7f853c13e820 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f8523fff640 10 client.22213.objecter ms_dispatch 0x7f853c000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f8523fff640 3 client.22213.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:13.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.452+0000 7f8523fff640 3 client.22213.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.453+0000 7f8523fff640 20 client.22213.objecter dump_active .. 0 homeless 2023-11-01T03:41:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.690+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8530054c30 con 0x7f853c13e820 2023-11-01T03:41:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.690+0000 7f8523fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.690+0000 7f8523fff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:13.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.885+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f853c142780 con 0x7f852806c850 2023-11-01T03:41:13.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.886+0000 7f8523fff640 1 -- 172.21.15.5:0/473106582 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f852c03a420 con 0x7f852806c850 2023-11-01T03:41:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2023-11-01T03:41:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 10 librados: watch_flush enter 2023-11-01T03:41:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 10 librados: watch_flush exit 2023-11-01T03:41:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 20 client.22213.objecter shutdown clearing up homeless session... 2023-11-01T03:41:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 10 client.22213.objecter successfully canceled tick 2023-11-01T03:41:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 msgr2=0x7f852806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 0x7f852806ed10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f852c036000 tx=0x7f852c03c040 comp rx=0 tx=0).stop 2023-11-01T03:41:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 10 monclient: shutdown 2023-11-01T03:41:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 msgr2=0x7f853c133020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.888+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 secure :-1 s=READY pgs=5559 cs=0 l=1 rev1=1 crypto rx=0x7f853000c450 tx=0x7f853000c910 comp rx=0 tx=0).stop 2023-11-01T03:41:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 shutdown_connections 2023-11-01T03:41:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f852806c850 0x7f852806ed10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f853c141c00 0x7f853c133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f853c13e820 0x7f853c133020 secure :-1 s=CLOSED pgs=5559 cs=0 l=1 rev1=1 crypto rx=0x7f853000c450 tx=0x7f853000c910 comp rx=0 tx=0).stop 2023-11-01T03:41:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 --2- 172.21.15.5:0/473106582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c06a040 0x7f853c145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 >> 172.21.15.5:0/473106582 conn(0x7f853c0b09a0 msgr2=0x7f853c13ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:13.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 shutdown_connections 2023-11-01T03:41:13.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 -- 172.21.15.5:0/473106582 wait complete. 2023-11-01T03:41:13.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:13.889+0000 7f85421b6640 1 librados: shutdown 2023-11-01T03:41:13.904 INFO:tasks.ceph:Scrubbing osd.4 2023-11-01T03:41:13.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.018+0000 7ffbde3d7640 10 monclient: get_monmap_and_config 2023-11-01T03:41:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.018+0000 7ffbde3d7640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.018+0000 7ffbde3d7640 10 monclient: monmap: 2023-11-01T03:41:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:14.019454+0000 2023-11-01T03:41:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:14.019454+0000 2023-11-01T03:41:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:14.021 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 Processor -- start 2023-11-01T03:41:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 -- start start 2023-11-01T03:41:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient: init 2023-11-01T03:41:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2023-11-01T03:41:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffbd80b42c0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80a8770 0x7ffbd813f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-b con 0x7ffbd80a8770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd80a9210 0x7ffbd8144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-a con 0x7ffbd80a9210 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80a8d00 con 0x7ffbd80b42c0 2023-11-01T03:41:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.019+0000 7ffbde3d7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd80b46a0 con 0x7ffbd80a9210 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.020+0000 7ffbde3d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.020+0000 7ffbde3d7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80ade80 con 0x7ffbd80a8770 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.020+0000 7ffbde3d7640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.020+0000 7ffbde3d7640 10 monclient(hunting): authenticate will time out at 2750.243986s 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.020+0000 7ffbdc974640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd80a9210 0x7ffbd8144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbd80a9210 0x7ffbd8144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55692/0 (socket says 172.21.15.5:55692) 2023-11-01T03:41:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 1 -- 172.21.15.5:0/1747621775 learned_addr learned my addr 172.21.15.5:0/1747621775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): get_auth_request con 0x7ffbd80a9210 auth_method 0 2023-11-01T03:41:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.021+0000 7ffbdc974640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 10 monclient(hunting): handle_auth_done global_id 15438 payload 274 2023-11-01T03:41:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 1 -- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80a8770 msgr2=0x7ffbd813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 1 --2- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80a8770 0x7ffbd813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 1 -- 172.21.15.5:0/1747621775 >> v1:172.21.15.153:6789/0 conn(0x7ffbd80b42c0 legacy=0x7ffbd813ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 1 monclient: found mon.noname-a 2023-11-01T03:41:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.024+0000 7ffbdc974640 1 -- 172.21.15.5:0/1747621775 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd81454a0 con 0x7ffbd80a9210 2023-11-01T03:41:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.026+0000 7ffbdc974640 1 --2- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd8144f60 secure :-1 s=READY pgs=2997 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e50 tx=0x7ffbd002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb72f2e3e188a58e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 1 -- 172.21.15.5:0/1747621775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd002c950 con 0x7ffbd80a9210 2023-11-01T03:41:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: dump: 2023-11-01T03:41:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.033 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.034 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 1 -- 172.21.15.5:0/1747621775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd002cab0 con 0x7ffbd80a9210 2023-11-01T03:41:14.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbde3d7640 5 monclient: authenticate success, global_id 15438 2023-11-01T03:41:14.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbde3d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:14.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbde3d7640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbde3d7640 4 set_mon_vals no callback set 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 1 -- 172.21.15.5:0/1747621775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd002ce40 con 0x7ffbd80a9210 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.031+0000 7ffbd6ffd640 10 monclient: dump: 2023-11-01T03:41:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.038 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 10 monclient: shutdown 2023-11-01T03:41:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 -- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 msgr2=0x7ffbd8144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd8144f60 secure :-1 s=READY pgs=2997 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009e50 tx=0x7ffbd002bdb0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 -- 172.21.15.5:0/1747621775 shutdown_connections 2023-11-01T03:41:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80a8770 0x7ffbd813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/1747621775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd8144f60 unknown :-1 s=CLOSED pgs=2997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 -- 172.21.15.5:0/1747621775 >> 172.21.15.5:0/1747621775 conn(0x7ffbd8065ee0 msgr2=0x7ffbd80662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 -- 172.21.15.5:0/1747621775 shutdown_connections 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 1 -- 172.21.15.5:0/1747621775 wait complete. 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.032+0000 7ffbde3d7640 10 monclient: monmap: 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 librados: starting msgr at 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 librados: starting objecter 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 Processor -- start 2023-11-01T03:41:14.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 -- start start 2023-11-01T03:41:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 librados: setting wanted keys 2023-11-01T03:41:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 1 librados: calling monclient init 2023-11-01T03:41:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.033+0000 7ffbde3d7640 10 monclient: init 2023-11-01T03:41:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd80a8770 0x7ffbd80b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-b con 0x7ffbd80a8770 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-a con 0x7ffbd80a9210 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80b42c0 0x7ffbd8134f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): picked mon.noname-c con 0x7ffbd80b42c0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80b5ef0 con 0x7ffbd80a9210 2023-11-01T03:41:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80b6a30 con 0x7ffbd80a8770 2023-11-01T03:41:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80b6ec0 con 0x7ffbd80b42c0 2023-11-01T03:41:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbde3d7640 10 monclient(hunting): authenticate will time out at 2750.258154s 2023-11-01T03:41:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.034+0000 7ffbd77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd80b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55702/0 (socket says 172.21.15.5:55702) 2023-11-01T03:41:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 1 -- 172.21.15.5:0/2377511154 learned_addr learned my addr 172.21.15.5:0/2377511154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): get_auth_request con 0x7ffbd80a9210 auth_method 0 2023-11-01T03:41:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.035+0000 7ffbd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 10 monclient(hunting): handle_auth_done global_id 15441 payload 824 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 -- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80b42c0 msgr2=0x7ffbd8134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffbd80b42c0 0x7ffbd8134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 -- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd80a8770 msgr2=0x7ffbd80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd80a8770 0x7ffbd80b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 monclient: found mon.noname-a 2023-11-01T03:41:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.038+0000 7ffbd77fe640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0009b30 con 0x7ffbd80a9210 2023-11-01T03:41:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.040+0000 7ffbd77fe640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd80b59b0 secure :-1 s=READY pgs=2998 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00b4a0 tx=0x7ffbcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.040+0000 7ffbd4ff9640 10 client.?.objecter ms_handle_connect 0x7ffbd80a9210 2023-11-01T03:41:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.040+0000 7ffbd4ff9640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc010610 con 0x7ffbd80a9210 2023-11-01T03:41:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: dump: 2023-11-01T03:41:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc010770 con 0x7ffbd80a9210 2023-11-01T03:41:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc010b20 con 0x7ffbd80a9210 2023-11-01T03:41:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 5 monclient: authenticate success, global_id 15441 2023-11-01T03:41:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 10 monclient: _renew_subs 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80b4ef0 con 0x7ffbd80a9210 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd4ff9640 10 monclient: dump: 2023-11-01T03:41:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbd67fc640 4 set_mon_vals no callback set 2023-11-01T03:41:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 10 client.15441.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 10 monclient: _renew_subs 2023-11-01T03:41:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd80ab0b0 con 0x7ffbd80a9210 2023-11-01T03:41:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.044+0000 7ffbde3d7640 1 librados: init done 2023-11-01T03:41:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 10 client.15441.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 15 client.15441.objecter _session_command_op_assign -1 1 2023-11-01T03:41:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 20 client.15441.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 10 client.15441.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.045+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffbd80b7e80 con 0x7ffbd80a9210 2023-11-01T03:41:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.066+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffbcc010c80 con 0x7ffbd80a9210 2023-11-01T03:41:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.066+0000 7ffbd4ff9640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffbc406c800 0x7ffbc406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.066+0000 7ffbd7fff640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffbc406c800 0x7ffbc406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.066+0000 7ffbd7fff640 10 monclient: get_auth_request con 0x7ffbc406c800 auth_method 0 2023-11-01T03:41:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.067+0000 7ffbd4ff9640 10 client.15441.objecter ms_handle_connect 0x7ffbc406c800 2023-11-01T03:41:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.067+0000 7ffbd7fff640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffbc406c800 0x7ffbc406ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009650 tx=0x7ffbc8006ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ffbcc058c60 con 0x7ffbd80a9210 2023-11-01T03:41:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 10 client.15441.objecter ms_dispatch 0x7ffbd8000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 3 client.15441.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 3 client.15441.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 10 client.15441.objecter checking command 1 2023-11-01T03:41:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7ffbc4074060 0x7ffbc4076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter _get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 15 client.15441.objecter _session_command_op_remove -1 1 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter _get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 15 client.15441.objecter _session_command_op_assign 4 1 2023-11-01T03:41:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 4 2023-11-01T03:41:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 10 client.15441.objecter _send_command 1 2023-11-01T03:41:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbc4076bd0 con 0x7ffbc4074060 2023-11-01T03:41:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 20 client.15441.objecter dump_active .. 0 homeless 2023-11-01T03:41:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbcc0092f0 con 0x7ffbd80a9210 2023-11-01T03:41:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbd4ff9640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.070+0000 7ffbdc974640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7ffbc4074060 0x7ffbc4076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.071+0000 7ffbdc974640 10 monclient: get_auth_request con 0x7ffbc4074060 auth_method 0 2023-11-01T03:41:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.074+0000 7ffbdc974640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7ffbc4074060 0x7ffbc4076500 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.074+0000 7ffbd4ff9640 10 client.15441.objecter ms_handle_connect 0x7ffbc4074060 2023-11-01T03:41:14.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.097+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== osd.4 v2:172.21.15.153:6824/439822656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ffbc4076bd0 con 0x7ffbc4074060 2023-11-01T03:41:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.097+0000 7ffbd4ff9640 10 client.15441.objecter ms_dispatch 0x7ffbd8000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.097+0000 7ffbd4ff9640 10 client.15441.objecter _finish_command 1 = system:0 2023-11-01T03:41:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.097+0000 7ffbd4ff9640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 4 2023-11-01T03:41:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.097+0000 7ffbd4ff9640 15 client.15441.objecter _session_command_op_remove 4 1 2023-11-01T03:41:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 10 client.15441.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 15 client.15441.objecter _session_command_op_assign -1 2 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 20 client.15441.objecter _get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 20 client.15441.objecter _get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 15 client.15441.objecter _session_command_op_remove -1 2 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 20 client.15441.objecter get_session s=0x7ffbc4073990 osd=4 3 2023-11-01T03:41:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 15 client.15441.objecter _session_command_op_assign 4 2 2023-11-01T03:41:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 4 2023-11-01T03:41:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 10 client.15441.objecter _send_command 2 2023-11-01T03:41:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.110+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 --> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffbd8075530 con 0x7ffbc4074060 2023-11-01T03:41:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbd4ff9640 1 -- 172.21.15.5:0/2377511154 <== osd.4 v2:172.21.15.153:6824/439822656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffbd8075530 con 0x7ffbc4074060 2023-11-01T03:41:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbd4ff9640 10 client.15441.objecter ms_dispatch 0x7ffbd8000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbd4ff9640 10 client.15441.objecter _finish_command 2 = system:0 2023-11-01T03:41:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbd4ff9640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 4 2023-11-01T03:41:14.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbd4ff9640 15 client.15441.objecter _session_command_op_remove 4 2 2023-11-01T03:41:14.128 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:14.128 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 10 librados: watch_flush enter 2023-11-01T03:41:14.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 10 librados: watch_flush exit 2023-11-01T03:41:14.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 10 client.15441.objecter close_session for osd.4 2023-11-01T03:41:14.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7ffbc4074060 msgr2=0x7ffbc4076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.153:6824/439822656,v1:172.21.15.153:6825/439822656] conn(0x7ffbc4074060 0x7ffbc4076500 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 20 client.15441.objecter put_session s=0x7ffbc4073990 osd=4 1 2023-11-01T03:41:14.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 20 client.15441.objecter shutdown clearing up homeless session... 2023-11-01T03:41:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 10 client.15441.objecter successfully canceled tick 2023-11-01T03:41:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffbc406c800 msgr2=0x7ffbc406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffbc406c800 0x7ffbc406ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009650 tx=0x7ffbc8006ba0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 10 monclient: shutdown 2023-11-01T03:41:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 msgr2=0x7ffbd80b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 --2- 172.21.15.5:0/2377511154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd80a9210 0x7ffbd80b59b0 secure :-1 s=READY pgs=2998 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00b4a0 tx=0x7ffbcc00b960 comp rx=0 tx=0).stop 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbdc974640 1 -- 172.21.15.5:0/2377511154 reap_dead start 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 shutdown_connections 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 >> 172.21.15.5:0/2377511154 conn(0x7ffbd8065ee0 msgr2=0x7ffbd8139690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 shutdown_connections 2023-11-01T03:41:14.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 -- 172.21.15.5:0/2377511154 wait complete. 2023-11-01T03:41:14.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.126+0000 7ffbde3d7640 1 librados: shutdown 2023-11-01T03:41:14.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-01T03:41:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 10 monclient: get_monmap_and_config 2023-11-01T03:41:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 10 monclient: monmap: 2023-11-01T03:41:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:14.245956+0000 2023-11-01T03:41:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:14.245956+0000 2023-11-01T03:41:14.246 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:14.247 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:14.248 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:14.248 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 1 Processor -- start 2023-11-01T03:41:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 1 -- start start 2023-11-01T03:41:14.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.245+0000 7f6634ad0640 10 monclient: init 2023-11-01T03:41:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2023-11-01T03:41:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f66300a8ae0 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 0x7f6630145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-b con 0x7f663013f340 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f66300a8ec0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300a9600 con 0x7f66300a8ae0 2023-11-01T03:41:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6630145c50 con 0x7f66300a8ec0 2023-11-01T03:41:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300a9360 con 0x7f663013f340 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6634ad0640 10 monclient(hunting): authenticate will time out at 2750.470383s 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.246+0000 7f6627fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 0x7f6630145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f662e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f66300a8ae0 0x7f663013ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47978/0 (socket says 172.21.15.5:47978) 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f662e59c640 1 -- 172.21.15.5:0/2067000902 learned_addr learned my addr 172.21.15.5:0/2067000902 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): get_auth_request con 0x7f663013f340 auth_method 0 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.247+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 10 monclient(hunting): handle_auth_done global_id 17390 payload 274 2023-11-01T03:41:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 1 -- 172.21.15.5:0/2067000902 >> v1:172.21.15.153:6789/0 conn(0x7f66300a8ec0 legacy=0x7f6630145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 1 -- 172.21.15.5:0/2067000902 >> v1:172.21.15.5:6789/0 conn(0x7f66300a8ae0 legacy=0x7f663013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 1 monclient: found mon.noname-b 2023-11-01T03:41:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.249+0000 7f6627fff640 1 -- 172.21.15.5:0/2067000902 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300b80b0 con 0x7f663013f340 2023-11-01T03:41:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.251+0000 7f6627fff640 1 --2- 172.21.15.5:0/2067000902 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 0x7f6630145000 secure :-1 s=READY pgs=2900 cs=0 l=1 rev1=1 crypto rx=0x7f66180097d0 tx=0x7f661802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c0e82a3891e42f server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 1 -- 172.21.15.5:0/2067000902 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618031800 con 0x7f663013f340 2023-11-01T03:41:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: dump: 2023-11-01T03:41:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.259 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f6634ad0640 5 monclient: authenticate success, global_id 17390 2023-11-01T03:41:14.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 1 -- 172.21.15.5:0/2067000902 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618031960 con 0x7f663013f340 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f6634ad0640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f6634ad0640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f6634ad0640 4 set_mon_vals no callback set 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 1 -- 172.21.15.5:0/2067000902 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618031cf0 con 0x7f663013f340 2023-11-01T03:41:14.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.254+0000 7f662dd9b640 10 monclient: dump: 2023-11-01T03:41:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.262 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.263 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 10 monclient: shutdown 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 -- 172.21.15.5:0/2067000902 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 msgr2=0x7f6630145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2067000902 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 0x7f6630145000 secure :-1 s=READY pgs=2900 cs=0 l=1 rev1=1 crypto rx=0x7f66180097d0 tx=0x7f661802b8a0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 -- 172.21.15.5:0/2067000902 shutdown_connections 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2067000902 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f663013f340 0x7f6630145000 unknown :-1 s=CLOSED pgs=2900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 -- 172.21.15.5:0/2067000902 >> 172.21.15.5:0/2067000902 conn(0x7f66300b7230 msgr2=0x7f66300b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 -- 172.21.15.5:0/2067000902 shutdown_connections 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.255+0000 7f6634ad0640 1 -- 172.21.15.5:0/2067000902 wait complete. 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.256+0000 7f6634ad0640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.256+0000 7f6634ad0640 10 monclient: monmap: 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.266 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:14.267 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.256+0000 7f6634ad0640 1 librados: starting msgr at 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.256+0000 7f6634ad0640 1 librados: starting objecter 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 Processor -- start 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 -- start start 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 librados: setting wanted keys 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 librados: calling monclient init 2023-11-01T03:41:14.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient: init 2023-11-01T03:41:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-c con 0x7f66300a8ae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300a8ec0 0x7f66301d6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-b con 0x7f66300a8ec0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663013f340 0x7f66301d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): picked mon.noname-a con 0x7f663013f340 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300b66c0 con 0x7f663013f340 2023-11-01T03:41:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300b69a0 con 0x7f66300a8ec0 2023-11-01T03:41:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300b5280 con 0x7f66300a8ae0 2023-11-01T03:41:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.257+0000 7f6634ad0640 10 monclient(hunting): authenticate will time out at 2750.481597s 2023-11-01T03:41:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f6627fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300a8ec0 0x7f66301d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47164/0 (socket says 172.21.15.5:47164) 2023-11-01T03:41:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 1 -- 172.21.15.5:0/2194564355 learned_addr learned my addr 172.21.15.5:0/2194564355 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 10 monclient(hunting): get_auth_request con 0x7f66300a8ae0 auth_method 0 2023-11-01T03:41:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662e59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662ed9d640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663013f340 0x7f66301d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662ed9d640 10 monclient(hunting): get_auth_request con 0x7f663013f340 auth_method 0 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662ed9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f662ed9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f6627fff640 10 monclient(hunting): get_auth_request con 0x7f66300a8ec0 auth_method 0 2023-11-01T03:41:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f6627fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f6627fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.258+0000 7f6627fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f6627fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.259+0000 7f662ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 10 monclient(hunting): handle_auth_done global_id 17393 payload 824 2023-11-01T03:41:14.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 -- 172.21.15.5:0/2194564355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300a8ec0 msgr2=0x7f66301d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300a8ec0 0x7f66301d6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 -- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663013f340 msgr2=0x7f66301d6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663013f340 0x7f66301d6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 monclient: found mon.noname-c 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.261+0000 7f662e59c640 1 -- 172.21.15.5:0/2194564355 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009400 con 0x7f66300a8ae0 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.264+0000 7f662e59c640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 secure :-1 s=READY pgs=2901 cs=0 l=1 rev1=1 crypto rx=0x7f662000c4b0 tx=0x7f662000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.264+0000 7f6626ffd640 10 client.?.objecter ms_handle_connect 0x7f66300a8ae0 2023-11-01T03:41:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.264+0000 7f6626ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620007480 con 0x7f66300a8ae0 2023-11-01T03:41:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: dump: 2023-11-01T03:41:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200075e0 con 0x7f66300a8ae0 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200059c0 con 0x7f66300a8ae0 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 5 monclient: authenticate success, global_id 17393 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 10 monclient: _renew_subs 2023-11-01T03:41:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663013b550 con 0x7f66300a8ae0 2023-11-01T03:41:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f662d59a640 4 set_mon_vals no callback set 2023-11-01T03:41:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6626ffd640 10 monclient: dump: 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 10 client.17393.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 10 monclient: _renew_subs 2023-11-01T03:41:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66300b7010 con 0x7f66300a8ae0 2023-11-01T03:41:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.267+0000 7f6634ad0640 1 librados: init done 2023-11-01T03:41:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.268+0000 7f6634ad0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.268+0000 7f6634ad0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.268+0000 7f6634ad0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.268+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663004e9f0 con 0x7f66300a8ae0 2023-11-01T03:41:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.529+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f662001b3b0 con 0x7f66300a8ae0 2023-11-01T03:41:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.529+0000 7f6626ffd640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 0x7f661006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.529+0000 7f6627fff640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 0x7f661006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.529+0000 7f6627fff640 10 monclient: get_auth_request con 0x7f661006c850 auth_method 0 2023-11-01T03:41:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.530+0000 7f6627fff640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 0x7f661006ed10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6618036000 tx=0x7f661803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.530+0000 7f6626ffd640 10 client.17393.objecter ms_handle_connect 0x7f661006c850 2023-11-01T03:41:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f6620057ea0 con 0x7f66300a8ae0 2023-11-01T03:41:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 10 client.17393.objecter ms_dispatch 0x7f6630000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 3 client.17393.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 3 client.17393.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 20 client.17393.objecter dump_active .. 0 homeless 2023-11-01T03:41:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66200541e0 con 0x7f66300a8ae0 2023-11-01T03:41:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.543+0000 7f6626ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.730+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f66300b6ae0 con 0x7f661006c850 2023-11-01T03:41:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.730+0000 7f6626ffd640 1 -- 172.21.15.5:0/2194564355 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f661803a420 con 0x7f661006c850 2023-11-01T03:41:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2023-11-01T03:41:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 10 librados: watch_flush enter 2023-11-01T03:41:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 10 librados: watch_flush exit 2023-11-01T03:41:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 20 client.17393.objecter shutdown clearing up homeless session... 2023-11-01T03:41:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 10 client.17393.objecter successfully canceled tick 2023-11-01T03:41:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 msgr2=0x7f661006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 0x7f661006ed10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6618036000 tx=0x7f661803c040 comp rx=0 tx=0).stop 2023-11-01T03:41:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 10 monclient: shutdown 2023-11-01T03:41:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 msgr2=0x7f66301444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 secure :-1 s=READY pgs=2901 cs=0 l=1 rev1=1 crypto rx=0x7f662000c4b0 tx=0x7f662000c970 comp rx=0 tx=0).stop 2023-11-01T03:41:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 shutdown_connections 2023-11-01T03:41:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f661006c850 0x7f661006ed10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f663013f340 0x7f66301d6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66300a8ec0 0x7f66301d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 --2- 172.21.15.5:0/2194564355 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f66300a8ae0 0x7f66301444d0 unknown :-1 s=CLOSED pgs=2901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 >> 172.21.15.5:0/2194564355 conn(0x7f66300b7230 msgr2=0x7f66300b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 shutdown_connections 2023-11-01T03:41:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 -- 172.21.15.5:0/2194564355 wait complete. 2023-11-01T03:41:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.732+0000 7f6634ad0640 1 librados: shutdown 2023-11-01T03:41:14.743 INFO:tasks.ceph:Scrubbing osd.5 2023-11-01T03:41:14.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.852+0000 7f95fb6c2640 10 monclient: get_monmap_and_config 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.852+0000 7f95fb6c2640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.852+0000 7f95fb6c2640 10 monclient: monmap: 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:14.853230+0000 2023-11-01T03:41:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:14.853230+0000 2023-11-01T03:41:14.854 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.854 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.854 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:14.854 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:14.854 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:14.855 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:14.855 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:14.855 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.852+0000 7f95fb6c2640 1 Processor -- start 2023-11-01T03:41:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 1 -- start start 2023-11-01T03:41:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient: init 2023-11-01T03:41:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2023-11-01T03:41:14.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95f4065d60 0x7f95f40aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-a con 0x7f95f4065d60 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f95f413e8a0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f95f413ecf0 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40ad410 con 0x7f95f413ecf0 2023-11-01T03:41:14.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f406ee20 con 0x7f95f413e8a0 2023-11-01T03:41:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f4066140 con 0x7f95f4065d60 2023-11-01T03:41:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.853+0000 7f95fb6c2640 10 monclient(hunting): authenticate will time out at 2751.077714s 2023-11-01T03:41:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.854+0000 7f95f945e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95f4065d60 0x7f95f40aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.854+0000 7f95f8c5d640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f95f413e8a0 0x7f95f4144e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50958/0 (socket says 172.21.15.5:50958) 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.854+0000 7f95f8c5d640 1 -- 172.21.15.5:0/18812166 learned_addr learned my addr 172.21.15.5:0/18812166 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.854+0000 7f95f945e640 10 monclient(hunting): get_auth_request con 0x7f95f4065d60 auth_method 0 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.854+0000 7f95f945e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.855+0000 7f95f945e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.855+0000 7f95f945e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.855+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.855+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.855+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 1 -- 172.21.15.5:0/18812166 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122646508 0 0) 0x7f95f406ee20 con 0x7f95f413e8a0 2023-11-01T03:41:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 10 monclient(hunting): _negotiate 2023-11-01T03:41:14.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 10 monclient(hunting): my global_id is 22222 2023-11-01T03:41:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.857+0000 7f95f3fff640 1 -- 172.21.15.5:0/18812166 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95dc003520 con 0x7f95f413e8a0 2023-11-01T03:41:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 10 monclient(hunting): handle_auth_done global_id 15450 payload 274 2023-11-01T03:41:14.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 1 -- 172.21.15.5:0/18812166 >> v1:172.21.15.153:6789/0 conn(0x7f95f413e8a0 legacy=0x7f95f4144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 1 -- 172.21.15.5:0/18812166 >> v1:172.21.15.5:6789/0 conn(0x7f95f413ecf0 legacy=0x7f95f4145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 1 monclient: found mon.noname-a 2023-11-01T03:41:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.859+0000 7f95f945e640 1 -- 172.21.15.5:0/18812166 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f406f100 con 0x7f95f4065d60 2023-11-01T03:41:14.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.862+0000 7f95f945e640 1 --2- 172.21.15.5:0/18812166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f4065d60 0x7f95f40aced0 secure :-1 s=READY pgs=3001 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009d90 tx=0x7f95ec02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3934f1ffa124b1fb server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 1 -- 172.21.15.5:0/18812166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec02cbd0 con 0x7f95f4065d60 2023-11-01T03:41:14.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: dump: 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.867 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.869 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 1 -- 172.21.15.5:0/18812166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec02cd30 con 0x7f95f4065d60 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 1 -- 172.21.15.5:0/18812166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec02cea0 con 0x7f95f4065d60 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 5 monclient: authenticate success, global_id 15450 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 4 set_mon_vals no callback set 2023-11-01T03:41:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95f3fff640 10 monclient: dump: 2023-11-01T03:41:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.873 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 10 monclient: shutdown 2023-11-01T03:41:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 -- 172.21.15.5:0/18812166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f4065d60 msgr2=0x7f95f40aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 --2- 172.21.15.5:0/18812166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f4065d60 0x7f95f40aced0 secure :-1 s=READY pgs=3001 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009d90 tx=0x7f95ec02be20 comp rx=0 tx=0).stop 2023-11-01T03:41:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 -- 172.21.15.5:0/18812166 shutdown_connections 2023-11-01T03:41:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 --2- 172.21.15.5:0/18812166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f4065d60 0x7f95f40aced0 unknown :-1 s=CLOSED pgs=3001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 -- 172.21.15.5:0/18812166 >> 172.21.15.5:0/18812166 conn(0x7f95f40b3d00 msgr2=0x7f95f40b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 -- 172.21.15.5:0/18812166 shutdown_connections 2023-11-01T03:41:14.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.866+0000 7f95fb6c2640 1 -- 172.21.15.5:0/18812166 wait complete. 2023-11-01T03:41:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.867+0000 7f95fb6c2640 10 monclient: build_initial_monmap 2023-11-01T03:41:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.867+0000 7f95fb6c2640 10 monclient: monmap: 2023-11-01T03:41:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:14.879 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 librados: starting msgr at 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 librados: starting objecter 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 Processor -- start 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 -- start start 2023-11-01T03:41:14.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 librados: setting wanted keys 2023-11-01T03:41:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 librados: calling monclient init 2023-11-01T03:41:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient: init 2023-11-01T03:41:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f4065d60 0x7f95f4143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-b con 0x7f95f4065d60 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 0x7f95f406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-a con 0x7f95f413e8a0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95f413ecf0 0x7f95f4071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): picked mon.noname-c con 0x7f95f413ecf0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f413af90 con 0x7f95f413e8a0 2023-11-01T03:41:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4070e00 con 0x7f95f4065d60 2023-11-01T03:41:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4144540 con 0x7f95f413ecf0 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.868+0000 7f95fb6c2640 10 monclient(hunting): authenticate will time out at 2751.092725s 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 0x7f95f406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95f413ecf0 0x7f95f4071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f945e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f4065d60 0x7f95f4143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 0x7f95f406f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55732/0 (socket says 172.21.15.5:55732) 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95f413ecf0 0x7f95f4071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47174/0 (socket says 172.21.15.5:47174) 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 1 -- 172.21.15.5:0/2090768267 learned_addr learned my addr 172.21.15.5:0/2090768267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 10 monclient(hunting): get_auth_request con 0x7f95f413e8a0 auth_method 0 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f8c5d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 10 monclient(hunting): get_auth_request con 0x7f95f413ecf0 auth_method 0 2023-11-01T03:41:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f9c5f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f945e640 10 monclient(hunting): get_auth_request con 0x7f95f4065d60 auth_method 0 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f945e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f945e640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.869+0000 7f95f945e640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f8c5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f8c5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f8c5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f9c5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f9c5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f9c5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.870+0000 7f95f945e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 10 monclient(hunting): handle_auth_done global_id 15456 payload 824 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 -- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95f413ecf0 msgr2=0x7f95f4071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f95f413ecf0 0x7f95f4071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 -- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f4065d60 msgr2=0x7f95f4143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f4065d60 0x7f95f4143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 10 monclient: _finish_hunting 0 2023-11-01T03:41:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 monclient: found mon.noname-a 2023-11-01T03:41:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f8c5d640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009a70 con 0x7f95f413e8a0 2023-11-01T03:41:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.872+0000 7f95f945e640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95f4065d60 0x7f95f4143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-01T03:41:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.875+0000 7f95f8c5d640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 0x7f95f406f9c0 secure :-1 s=READY pgs=3002 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c500 tx=0x7f95e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.875+0000 7f95f1ffb640 10 client.?.objecter ms_handle_connect 0x7f95f413e8a0 2023-11-01T03:41:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.875+0000 7f95f1ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.878+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8005ce0 con 0x7f95f413e8a0 2023-11-01T03:41:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: dump: 2023-11-01T03:41:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.895 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: _finish_auth 0 2023-11-01T03:41:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:41:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8005e40 con 0x7f95f413e8a0 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8007330 con 0x7f95f413e8a0 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f1ffb640 10 monclient: dump: 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:14.898 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 5 monclient: authenticate success, global_id 15456 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 10 monclient: _renew_subs 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f413a290 con 0x7f95f413e8a0 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95f37fe640 4 set_mon_vals no callback set 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 10 client.15456.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 10 monclient: _renew_subs 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f413acc0 con 0x7f95f413e8a0 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.879+0000 7f95fb6c2640 1 librados: init done 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 10 client.15456.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 15 client.15456.objecter _session_command_op_assign -1 1 2023-11-01T03:41:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 20 client.15456.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 10 client.15456.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.880+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95f413f120 con 0x7f95f413e8a0 2023-11-01T03:41:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.899+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f95e8007490 con 0x7f95f413e8a0 2023-11-01T03:41:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.900+0000 7f95f1ffb640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f95e006c850 0x7f95e006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.900+0000 7f95f945e640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f95e006c850 0x7f95e006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.900+0000 7f95f945e640 10 monclient: get_auth_request con 0x7f95e006c850 auth_method 0 2023-11-01T03:41:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.900+0000 7f95f1ffb640 10 client.15456.objecter ms_handle_connect 0x7f95e006c850 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.900+0000 7f95f945e640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f95e006c850 0x7f95e006ed10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95ec036000 tx=0x7f95ec030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f95e8007740 con 0x7f95f413e8a0 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 10 client.15456.objecter ms_dispatch 0x7f95f4000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 3 client.15456.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 3 client.15456.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 10 client.15456.objecter checking command 1 2023-11-01T03:41:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f95e00740b0 0x7f95e0076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter _get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 15 client.15456.objecter _session_command_op_remove -1 1 2023-11-01T03:41:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter _get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 15 client.15456.objecter _session_command_op_assign 5 1 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 4 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 10 client.15456.objecter _send_command 1 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95e0076c20 con 0x7f95e00740b0 2023-11-01T03:41:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.902+0000 7f95f1ffb640 20 client.15456.objecter dump_active .. 0 homeless 2023-11-01T03:41:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.903+0000 7f95f9c5f640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f95e00740b0 0x7f95e0076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.903+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e8057fc0 con 0x7f95f413e8a0 2023-11-01T03:41:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.903+0000 7f95f1ffb640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.903+0000 7f95f9c5f640 10 monclient: get_auth_request con 0x7f95e00740b0 auth_method 0 2023-11-01T03:41:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.906+0000 7f95f9c5f640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f95e00740b0 0x7f95e0076550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.906+0000 7f95f1ffb640 10 client.15456.objecter ms_handle_connect 0x7f95e00740b0 2023-11-01T03:41:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.929+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== osd.5 v2:172.21.15.153:6816/3310991586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f95e0076c20 con 0x7f95e00740b0 2023-11-01T03:41:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.929+0000 7f95f1ffb640 10 client.15456.objecter ms_dispatch 0x7f95f4000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.929+0000 7f95f1ffb640 10 client.15456.objecter _finish_command 1 = system:0 2023-11-01T03:41:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.929+0000 7f95f1ffb640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 4 2023-11-01T03:41:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.929+0000 7f95f1ffb640 15 client.15456.objecter _session_command_op_remove 5 1 2023-11-01T03:41:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 10 client.15456.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 15 client.15456.objecter _session_command_op_assign -1 2 2023-11-01T03:41:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 20 client.15456.objecter _get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 20 client.15456.objecter _get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 15 client.15456.objecter _session_command_op_remove -1 2 2023-11-01T03:41:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 20 client.15456.objecter get_session s=0x7f95e00739e0 osd=5 3 2023-11-01T03:41:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 15 client.15456.objecter _session_command_op_assign 5 2 2023-11-01T03:41:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 4 2023-11-01T03:41:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 10 client.15456.objecter _send_command 2 2023-11-01T03:41:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.944+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 --> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95f40ad680 con 0x7f95e00740b0 2023-11-01T03:41:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f1ffb640 1 -- 172.21.15.5:0/2090768267 <== osd.5 v2:172.21.15.153:6816/3310991586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f95e4001380 con 0x7f95e00740b0 2023-11-01T03:41:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f1ffb640 10 client.15456.objecter ms_dispatch 0x7f95f4000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f1ffb640 10 client.15456.objecter _finish_command 2 = system:0 2023-11-01T03:41:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f1ffb640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 4 2023-11-01T03:41:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f1ffb640 15 client.15456.objecter _session_command_op_remove 5 2 2023-11-01T03:41:14.959 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:14.960 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:14.960 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 10 librados: watch_flush enter 2023-11-01T03:41:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 10 librados: watch_flush exit 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 10 client.15456.objecter close_session for osd.5 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f95e00740b0 msgr2=0x7f95e0076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.153:6816/3310991586,v1:172.21.15.153:6817/3310991586] conn(0x7f95e00740b0 0x7f95e0076550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 20 client.15456.objecter put_session s=0x7f95e00739e0 osd=5 1 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 20 client.15456.objecter shutdown clearing up homeless session... 2023-11-01T03:41:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 10 client.15456.objecter successfully canceled tick 2023-11-01T03:41:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f95e006c850 msgr2=0x7f95e006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f95e006c850 0x7f95e006ed10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95ec036000 tx=0x7f95ec030000 comp rx=0 tx=0).stop 2023-11-01T03:41:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 10 monclient: shutdown 2023-11-01T03:41:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 msgr2=0x7f95f406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 --2- 172.21.15.5:0/2090768267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95f413e8a0 0x7f95f406f9c0 secure :-1 s=READY pgs=3002 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c500 tx=0x7f95e800c9c0 comp rx=0 tx=0).stop 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95f9c5f640 1 -- 172.21.15.5:0/2090768267 reap_dead start 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 shutdown_connections 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 >> 172.21.15.5:0/2090768267 conn(0x7f95f40b3d00 msgr2=0x7f95f413d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 shutdown_connections 2023-11-01T03:41:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 -- 172.21.15.5:0/2090768267 wait complete. 2023-11-01T03:41:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:14.958+0000 7f95fb6c2640 1 librados: shutdown 2023-11-01T03:41:14.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-01T03:41:15.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 10 monclient: get_monmap_and_config 2023-11-01T03:41:15.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 10 monclient: monmap: 2023-11-01T03:41:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:15.086000+0000 2023-11-01T03:41:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:15.086000+0000 2023-11-01T03:41:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:15.088 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 1 Processor -- start 2023-11-01T03:41:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 1 -- start start 2023-11-01T03:41:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.085+0000 7f1ed3ab0640 10 monclient: init 2023-11-01T03:41:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient: _add_conns ranks=[0,3,4,1,2] 2023-11-01T03:41:15.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ecc0adc40 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:15.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 0x7f1ecc13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-a con 0x7f1ecc0aafc0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:15.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ecc0ace30 0x7f1ecc13eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-c con 0x7f1ecc0ace30 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0a9f60 con 0x7f1ecc0adc40 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0ae020 con 0x7f1ecc0aafc0 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0ac300 con 0x7f1ecc0ace30 2023-11-01T03:41:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.086+0000 7f1ed3ab0640 10 monclient(hunting): authenticate will time out at 2751.310464s 2023-11-01T03:41:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 0x7f1ecc13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed204d640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ecc0ace30 0x7f1ecc13eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 0x7f1ecc13e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55742/0 (socket says 172.21.15.5:55742) 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 1 -- 172.21.15.5:0/1346437688 learned_addr learned my addr 172.21.15.5:0/1346437688 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 10 monclient(hunting): get_auth_request con 0x7f1ecc0aafc0 auth_method 0 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed104b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed204d640 10 monclient(hunting): get_auth_request con 0x7f1ecc0ace30 auth_method 0 2023-11-01T03:41:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed204d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed204d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.087+0000 7f1ed204d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed204d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed204d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed204d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.088+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 10 monclient(hunting): handle_auth_done global_id 22228 payload 274 2023-11-01T03:41:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 1 -- 172.21.15.5:0/1346437688 >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 msgr2=0x7f1ecc13e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 1 --2- 172.21.15.5:0/1346437688 >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 0x7f1ecc13e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 1 -- 172.21.15.5:0/1346437688 >> v1:172.21.15.5:6789/0 conn(0x7f1ecc0adc40 legacy=0x7f1ecc0ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 1 monclient: found mon.noname-c 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.089+0000 7f1ed204d640 1 -- 172.21.15.5:0/1346437688 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc13c1d0 con 0x7f1ecc0ace30 2023-11-01T03:41:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.091+0000 7f1ed204d640 1 --2- 172.21.15.5:0/1346437688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13eee0 secure :-1 s=READY pgs=5562 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0a9990 tx=0x7f1ec802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b188ac8a41ebf9d server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 1 -- 172.21.15.5:0/1346437688 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec802cb60 con 0x7f1ecc0ace30 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: dump: 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 1 -- 172.21.15.5:0/1346437688 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec802ccc0 con 0x7f1ecc0ace30 2023-11-01T03:41:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 1 -- 172.21.15.5:0/1346437688 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8034660 con 0x7f1ecc0ace30 2023-11-01T03:41:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed3ab0640 5 monclient: authenticate success, global_id 22228 2023-11-01T03:41:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed3ab0640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed3ab0640 4 set_mon_vals no callback set 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.095+0000 7f1ed084a640 10 monclient: dump: 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 10 monclient: shutdown 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/1346437688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 msgr2=0x7f1ecc13eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/1346437688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13eee0 secure :-1 s=READY pgs=5562 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0a9990 tx=0x7f1ec802bdb0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/1346437688 shutdown_connections 2023-11-01T03:41:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/1346437688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13eee0 unknown :-1 s=CLOSED pgs=5562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/1346437688 >> v2:172.21.15.5:3300/0 conn(0x7f1ecc0aafc0 0x7f1ecc13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/1346437688 >> 172.21.15.5:0/1346437688 conn(0x7f1ecc0b2ff0 msgr2=0x7f1ecc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/1346437688 shutdown_connections 2023-11-01T03:41:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.096+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/1346437688 wait complete. 2023-11-01T03:41:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 10 monclient: monmap: 2023-11-01T03:41:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 librados: starting msgr at 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 librados: starting objecter 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 Processor -- start 2023-11-01T03:41:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 -- start start 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 librados: setting wanted keys 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 1 librados: calling monclient init 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.097+0000 7f1ed3ab0640 10 monclient: init 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:41:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-b con 0x7f1ecc0ace30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 0x7f1ecc13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-c con 0x7f1ecc0adc40 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc13c490 0x7f1ecc1d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): picked mon.noname-a con 0x7f1ecc13c490 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc13e460 con 0x7f1ecc13c490 2023-11-01T03:41:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1d24e0 con 0x7f1ecc0ace30 2023-11-01T03:41:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc133300 con 0x7f1ecc0adc40 2023-11-01T03:41:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.098+0000 7f1ed3ab0640 10 monclient(hunting): authenticate will time out at 2751.322555s 2023-11-01T03:41:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 0x7f1ecc13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed184c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 0x7f1ecc13d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47184/0 (socket says 172.21.15.5:47184) 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 1 -- 172.21.15.5:0/3843909107 learned_addr learned my addr 172.21.15.5:0/3843909107 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 10 monclient(hunting): get_auth_request con 0x7f1ecc0adc40 auth_method 0 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed104b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed184c640 10 monclient(hunting): get_auth_request con 0x7f1ecc0ace30 auth_method 0 2023-11-01T03:41:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed184c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed184c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.099+0000 7f1ed184c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed184c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed184c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed184c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.100+0000 7f1ed104b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 10 monclient(hunting): handle_auth_done global_id 22231 payload 824 2023-11-01T03:41:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 -- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 msgr2=0x7f1ecc13d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 0x7f1ecc13d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 -- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc13c490 msgr2=0x7f1ecc1d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc13c490 0x7f1ecc1d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 monclient: found mon.noname-b 2023-11-01T03:41:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.102+0000 7f1ed184c640 1 -- 172.21.15.5:0/3843909107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009a70 con 0x7f1ecc0ace30 2023-11-01T03:41:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.105+0000 7f1ed184c640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13de20 secure :-1 s=READY pgs=5563 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c3c0 tx=0x7f1ec400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.105+0000 7f1ebe7fc640 10 client.?.objecter ms_handle_connect 0x7f1ecc0ace30 2023-11-01T03:41:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.105+0000 7f1ebe7fc640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40052d0 con 0x7f1ecc0ace30 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 10 monclient: dump: 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ebe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 5 monclient: authenticate success, global_id 22231 2023-11-01T03:41:15.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 10 monclient: _renew_subs 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc1d2f00 con 0x7f1ecc0ace30 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 10 client.22231.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 10 monclient: _renew_subs 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc1d3460 con 0x7f1ecc0ace30 2023-11-01T03:41:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.107+0000 7f1ed3ab0640 1 librados: init done 2023-11-01T03:41:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.108+0000 7f1ed3ab0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.108+0000 7f1ed3ab0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.108+0000 7f1ed3ab0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.108+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc0aa940 con 0x7f1ecc0ace30 2023-11-01T03:41:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4005430 con 0x7f1ecc0ace30 2023-11-01T03:41:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4007220 con 0x7f1ecc0ace30 2023-11-01T03:41:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebe7fc640 10 monclient: dump: 2023-11-01T03:41:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.351 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.347+0000 7f1ebffff640 4 set_mon_vals no callback set 2023-11-01T03:41:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.348+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ec4007440 con 0x7f1ecc0ace30 2023-11-01T03:41:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.348+0000 7f1ebe7fc640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 0x7f1eb006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.349+0000 7f1ed104b640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 0x7f1eb006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.349+0000 7f1ed104b640 10 monclient: get_auth_request con 0x7f1eb006c830 auth_method 0 2023-11-01T03:41:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.349+0000 7f1ed104b640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 0x7f1eb006ecf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000bf10 tx=0x7f1ec000b450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.349+0000 7f1ebe7fc640 10 client.22231.objecter ms_handle_connect 0x7f1eb006c830 2023-11-01T03:41:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.350+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f1ec4057b20 con 0x7f1ecc0ace30 2023-11-01T03:41:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.350+0000 7f1ebe7fc640 10 client.22231.objecter ms_dispatch 0x7f1ecc000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.350+0000 7f1ebe7fc640 3 client.22231.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.350+0000 7f1ebe7fc640 3 client.22231.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.351+0000 7f1ebe7fc640 20 client.22231.objecter dump_active .. 0 homeless 2023-11-01T03:41:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.362+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ec4053e60 con 0x7f1ecc0ace30 2023-11-01T03:41:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.362+0000 7f1ebe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.362+0000 7f1ebe7fc640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.543+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ecc0a9b60 con 0x7f1eb006c830 2023-11-01T03:41:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.543+0000 7f1ebe7fc640 1 -- 172.21.15.5:0/3843909107 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ec000bb60 con 0x7f1eb006c830 2023-11-01T03:41:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2023-11-01T03:41:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.545+0000 7f1ed3ab0640 10 librados: watch_flush enter 2023-11-01T03:41:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.545+0000 7f1ed3ab0640 10 librados: watch_flush exit 2023-11-01T03:41:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.545+0000 7f1ed3ab0640 20 client.22231.objecter shutdown clearing up homeless session... 2023-11-01T03:41:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.545+0000 7f1ed3ab0640 10 client.22231.objecter successfully canceled tick 2023-11-01T03:41:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 msgr2=0x7f1eb006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 0x7f1eb006ecf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000bf10 tx=0x7f1ec000b450 comp rx=0 tx=0).stop 2023-11-01T03:41:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 10 monclient: shutdown 2023-11-01T03:41:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 msgr2=0x7f1ecc13de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13de20 secure :-1 s=READY pgs=5563 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c3c0 tx=0x7f1ec400c880 comp rx=0 tx=0).stop 2023-11-01T03:41:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 shutdown_connections 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f1eb006c830 0x7f1eb006ecf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ecc13c490 0x7f1ecc1d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f1ecc0adc40 0x7f1ecc13d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 --2- 172.21.15.5:0/3843909107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ecc0ace30 0x7f1ecc13de20 unknown :-1 s=CLOSED pgs=5563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 >> 172.21.15.5:0/3843909107 conn(0x7f1ecc0b2ff0 msgr2=0x7f1ecc0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 shutdown_connections 2023-11-01T03:41:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 -- 172.21.15.5:0/3843909107 wait complete. 2023-11-01T03:41:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.546+0000 7f1ed3ab0640 1 librados: shutdown 2023-11-01T03:41:15.557 INFO:tasks.ceph:Scrubbing osd.6 2023-11-01T03:41:15.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.666+0000 7fc488eec640 10 monclient: get_monmap_and_config 2023-11-01T03:41:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.666+0000 7fc488eec640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.666+0000 7fc488eec640 10 monclient: monmap: 2023-11-01T03:41:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:15.667885+0000 2023-11-01T03:41:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:15.667885+0000 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:15.670 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.667+0000 7fc488eec640 1 Processor -- start 2023-11-01T03:41:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.667+0000 7fc488eec640 1 -- start start 2023-11-01T03:41:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.667+0000 7fc488eec640 10 monclient: init 2023-11-01T03:41:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2023-11-01T03:41:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4840b42c0 0x7fc4840a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-a con 0x7fc4840b42c0 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc4840a8770 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc48413f300 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840a8d00 con 0x7fc4840a8770 2023-11-01T03:41:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840ade80 con 0x7fc48413f300 2023-11-01T03:41:15.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840ae010 con 0x7fc4840b42c0 2023-11-01T03:41:15.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.668+0000 7fc488eec640 10 monclient(hunting): authenticate will time out at 2751.892364s 2023-11-01T03:41:15.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.669+0000 7fc482d9d640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc48413f300 0x7fc484144f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:50972/0 (socket says 172.21.15.5:50972) 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.669+0000 7fc482d9d640 1 -- 172.21.15.5:0/68385918 learned_addr learned my addr 172.21.15.5:0/68385918 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.670+0000 7fc48259c640 1 --2- 172.21.15.5:0/68385918 >> v2:172.21.15.5:3300/0 conn(0x7fc4840b42c0 0x7fc4840a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc48259c640 10 monclient(hunting): get_auth_request con 0x7fc4840b42c0 auth_method 0 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc48259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc48259c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc48259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 1 -- 172.21.15.5:0/68385918 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118608293 0 0) 0x7fc4840ade80 con 0x7fc48413f300 2023-11-01T03:41:15.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 10 monclient(hunting): _negotiate 2023-11-01T03:41:15.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 10 monclient(hunting): my global_id is 22234 2023-11-01T03:41:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.671+0000 7fc481d9b640 1 -- 172.21.15.5:0/68385918 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc470003520 con 0x7fc48413f300 2023-11-01T03:41:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.672+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.672+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.672+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.673+0000 7fc48259c640 10 monclient(hunting): handle_auth_done global_id 15465 payload 274 2023-11-01T03:41:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.673+0000 7fc48259c640 1 -- 172.21.15.5:0/68385918 >> v1:172.21.15.153:6789/0 conn(0x7fc48413f300 legacy=0x7fc484144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 1 -- 172.21.15.5:0/68385918 >> v1:172.21.15.5:6789/0 conn(0x7fc4840a8770 legacy=0x7fc48413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 1 monclient: found mon.noname-a 2023-11-01T03:41:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.674+0000 7fc48259c640 1 -- 172.21.15.5:0/68385918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484145670 con 0x7fc4840b42c0 2023-11-01T03:41:15.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.678+0000 7fc48259c640 1 --2- 172.21.15.5:0/68385918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4840a9210 secure :-1 s=READY pgs=3005 cs=0 l=1 rev1=1 crypto rx=0x7fc4740097a0 tx=0x7fc47402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e1022837271a5e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 1 -- 172.21.15.5:0/68385918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47402e070 con 0x7fc4840b42c0 2023-11-01T03:41:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: dump: 2023-11-01T03:41:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.684 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.685 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 1 -- 172.21.15.5:0/68385918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740315a0 con 0x7fc4840b42c0 2023-11-01T03:41:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc488eec640 5 monclient: authenticate success, global_id 15465 2023-11-01T03:41:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc488eec640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:15.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc488eec640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc488eec640 4 set_mon_vals no callback set 2023-11-01T03:41:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 1 -- 172.21.15.5:0/68385918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474031930 con 0x7fc4840b42c0 2023-11-01T03:41:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.682+0000 7fc481d9b640 10 monclient: dump: 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.689 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 10 monclient: shutdown 2023-11-01T03:41:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 -- 172.21.15.5:0/68385918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 msgr2=0x7fc4840a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 --2- 172.21.15.5:0/68385918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4840a9210 secure :-1 s=READY pgs=3005 cs=0 l=1 rev1=1 crypto rx=0x7fc4740097a0 tx=0x7fc47402b840 comp rx=0 tx=0).stop 2023-11-01T03:41:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 -- 172.21.15.5:0/68385918 shutdown_connections 2023-11-01T03:41:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 --2- 172.21.15.5:0/68385918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4840a9210 unknown :-1 s=CLOSED pgs=3005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 -- 172.21.15.5:0/68385918 >> 172.21.15.5:0/68385918 conn(0x7fc484065ee0 msgr2=0x7fc4840662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 -- 172.21.15.5:0/68385918 shutdown_connections 2023-11-01T03:41:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.683+0000 7fc488eec640 1 -- 172.21.15.5:0/68385918 wait complete. 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 10 monclient: monmap: 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:15.695 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:15.697 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 librados: starting msgr at 2023-11-01T03:41:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 librados: starting objecter 2023-11-01T03:41:15.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 Processor -- start 2023-11-01T03:41:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 -- start start 2023-11-01T03:41:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 librados: setting wanted keys 2023-11-01T03:41:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 1 librados: calling monclient init 2023-11-01T03:41:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.684+0000 7fc488eec640 10 monclient: init 2023-11-01T03:41:15.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-01T03:41:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4840a8770 0x7fc4840ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-b con 0x7fc4840a8770 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4841d6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-a con 0x7fc4840b42c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc48413f300 0x7fc4841d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): picked mon.noname-c con 0x7fc48413f300 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841d70a0 con 0x7fc4840b42c0 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840af6d0 con 0x7fc4840a8770 2023-11-01T03:41:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b0b90 con 0x7fc48413f300 2023-11-01T03:41:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc488eec640 10 monclient(hunting): authenticate will time out at 2751.909295s 2023-11-01T03:41:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc482d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc48413f300 0x7fc4841d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4841d6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.685+0000 7fc48259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4840a8770 0x7fc4840ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc48413f300 0x7fc4841d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47194/0 (socket says 172.21.15.5:47194) 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 1 -- 172.21.15.5:0/2114235494 learned_addr learned my addr 172.21.15.5:0/2114235494 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): get_auth_request con 0x7fc48413f300 auth_method 0 2023-11-01T03:41:15.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): get_auth_request con 0x7fc4840a8770 auth_method 0 2023-11-01T03:41:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): get_auth_request con 0x7fc4840b42c0 auth_method 0 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc48259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc482d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.686+0000 7fc47bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 10 monclient(hunting): handle_auth_done global_id 22237 payload 824 2023-11-01T03:41:15.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 -- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc48413f300 msgr2=0x7fc4841d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fc48413f300 0x7fc4841d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 -- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 msgr2=0x7fc4841d6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4840b42c0 0x7fc4841d6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 monclient: found mon.noname-b 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.689+0000 7fc48259c640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc474009400 con 0x7fc4840a8770 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.691+0000 7fc48259c640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4840a8770 0x7fc4840ad840 secure :-1 s=READY pgs=5565 cs=0 l=1 rev1=1 crypto rx=0x7fc4840b4a80 tx=0x7fc4740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.691+0000 7fc47affd640 10 client.?.objecter ms_handle_connect 0x7fc4840a8770 2023-11-01T03:41:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.691+0000 7fc47affd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:15.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474032840 con 0x7fc4840a8770 2023-11-01T03:41:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: dump: 2023-11-01T03:41:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740329c0 con 0x7fc4840a8770 2023-11-01T03:41:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474032d70 con 0x7fc4840a8770 2023-11-01T03:41:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 5 monclient: authenticate success, global_id 22237 2023-11-01T03:41:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 10 monclient: _renew_subs 2023-11-01T03:41:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840b1350 con 0x7fc4840a8770 2023-11-01T03:41:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc48159a640 4 set_mon_vals no callback set 2023-11-01T03:41:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc47affd640 10 monclient: dump: 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 10 client.22237.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 10 monclient: _renew_subs 2023-11-01T03:41:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4840b03d0 con 0x7fc4840a8770 2023-11-01T03:41:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.695+0000 7fc488eec640 1 librados: init done 2023-11-01T03:41:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 10 client.22237.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 15 client.22237.objecter _session_command_op_assign -1 1 2023-11-01T03:41:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 20 client.22237.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 10 client.22237.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.696+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4840b46a0 con 0x7fc4840a8770 2023-11-01T03:41:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.713+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc47404d3c0 con 0x7fc4840a8770 2023-11-01T03:41:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.713+0000 7fc47affd640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc46406c850 0x7fc46406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.714+0000 7fc47bfff640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc46406c850 0x7fc46406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.714+0000 7fc47bfff640 10 monclient: get_auth_request con 0x7fc46406c850 auth_method 0 2023-11-01T03:41:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.714+0000 7fc47affd640 10 client.22237.objecter ms_handle_connect 0x7fc46406c850 2023-11-01T03:41:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.714+0000 7fc47bfff640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc46406c850 0x7fc46406ed10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc4840adf20 tx=0x7fc46c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.716+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fc47407a260 con 0x7fc4840a8770 2023-11-01T03:41:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.716+0000 7fc47affd640 10 client.22237.objecter ms_dispatch 0x7fc484000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.716+0000 7fc47affd640 3 client.22237.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.716+0000 7fc47affd640 3 client.22237.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 10 client.22237.objecter checking command 1 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fc4640740b0 0x7fc464076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter _get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 15 client.22237.objecter _session_command_op_remove -1 1 2023-11-01T03:41:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter _get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 15 client.22237.objecter _session_command_op_assign 6 1 2023-11-01T03:41:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 4 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 10 client.22237.objecter _send_command 1 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc464076c20 con 0x7fc4640740b0 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc47affd640 20 client.22237.objecter dump_active .. 0 homeless 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.717+0000 7fc482d9d640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fc4640740b0 0x7fc464076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.718+0000 7fc482d9d640 10 monclient: get_auth_request con 0x7fc4640740b0 auth_method 0 2023-11-01T03:41:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.718+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4740765a0 con 0x7fc4840a8770 2023-11-01T03:41:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.718+0000 7fc47affd640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.720+0000 7fc482d9d640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fc4640740b0 0x7fc464076550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.720+0000 7fc47affd640 10 client.22237.objecter ms_handle_connect 0x7fc4640740b0 2023-11-01T03:41:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.742+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== osd.6 v2:172.21.15.153:6800/1447491004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc464076c20 con 0x7fc4640740b0 2023-11-01T03:41:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.742+0000 7fc47affd640 10 client.22237.objecter ms_dispatch 0x7fc484000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.742+0000 7fc47affd640 10 client.22237.objecter _finish_command 1 = system:0 2023-11-01T03:41:15.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.742+0000 7fc47affd640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 4 2023-11-01T03:41:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.742+0000 7fc47affd640 15 client.22237.objecter _session_command_op_remove 6 1 2023-11-01T03:41:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 10 client.22237.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 15 client.22237.objecter _session_command_op_assign -1 2 2023-11-01T03:41:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 20 client.22237.objecter _get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 20 client.22237.objecter _get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 15 client.22237.objecter _session_command_op_remove -1 2 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 20 client.22237.objecter get_session s=0x7fc4640739e0 osd=6 3 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 15 client.22237.objecter _session_command_op_assign 6 2 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 4 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 10 client.22237.objecter _send_command 2 2023-11-01T03:41:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.755+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 --> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc484075530 con 0x7fc4640740b0 2023-11-01T03:41:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc47affd640 1 -- 172.21.15.5:0/2114235494 <== osd.6 v2:172.21.15.153:6800/1447491004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc484075530 con 0x7fc4640740b0 2023-11-01T03:41:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc47affd640 10 client.22237.objecter ms_dispatch 0x7fc484000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc47affd640 10 client.22237.objecter _finish_command 2 = system:0 2023-11-01T03:41:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc47affd640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 4 2023-11-01T03:41:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc47affd640 15 client.22237.objecter _session_command_op_remove 6 2 2023-11-01T03:41:15.770 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:15.771 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:15.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 10 librados: watch_flush enter 2023-11-01T03:41:15.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 10 librados: watch_flush exit 2023-11-01T03:41:15.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 10 client.22237.objecter close_session for osd.6 2023-11-01T03:41:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fc4640740b0 msgr2=0x7fc464076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:6800/1447491004,v1:172.21.15.153:6801/1447491004] conn(0x7fc4640740b0 0x7fc464076550 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 20 client.22237.objecter put_session s=0x7fc4640739e0 osd=6 1 2023-11-01T03:41:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 20 client.22237.objecter shutdown clearing up homeless session... 2023-11-01T03:41:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 10 client.22237.objecter successfully canceled tick 2023-11-01T03:41:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc46406c850 msgr2=0x7fc46406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fc46406c850 0x7fc46406ed10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc4840adf20 tx=0x7fc46c009040 comp rx=0 tx=0).stop 2023-11-01T03:41:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 10 monclient: shutdown 2023-11-01T03:41:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4840a8770 msgr2=0x7fc4840ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 --2- 172.21.15.5:0/2114235494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4840a8770 0x7fc4840ad840 secure :-1 s=READY pgs=5565 cs=0 l=1 rev1=1 crypto rx=0x7fc4840b4a80 tx=0x7fc4740046c0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc482d9d640 1 -- 172.21.15.5:0/2114235494 reap_dead start 2023-11-01T03:41:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 shutdown_connections 2023-11-01T03:41:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 >> 172.21.15.5:0/2114235494 conn(0x7fc484065ee0 msgr2=0x7fc48413e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 shutdown_connections 2023-11-01T03:41:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 -- 172.21.15.5:0/2114235494 wait complete. 2023-11-01T03:41:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.769+0000 7fc488eec640 1 librados: shutdown 2023-11-01T03:41:15.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-01T03:41:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.890+0000 7f089ca90640 10 monclient: get_monmap_and_config 2023-11-01T03:41:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.890+0000 7f089ca90640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.890+0000 7f089ca90640 10 monclient: monmap: 2023-11-01T03:41:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:15.891320+0000 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:15.891320+0000 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:15.893 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:15.893 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 Processor -- start 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 -- start start 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient: init 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0898071b80 0x7f08980ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-a con 0x7f0898071b80 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08980ad330 0x7f089813ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-c con 0x7f08980ad330 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-b con 0x7f089813f160 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0898071f60 con 0x7f0898071b80 2023-11-01T03:41:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089813f610 con 0x7f08980ad330 2023-11-01T03:41:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980aa800 con 0x7f089813f160 2023-11-01T03:41:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.891+0000 7f089ca90640 10 monclient(hunting): authenticate will time out at 2752.115788s 2023-11-01T03:41:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f089659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0898071b80 0x7f08980ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0895d9b640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f08980ad330 0x7f089813ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47202/0 (socket says 172.21.15.5:47202) 2023-11-01T03:41:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 1 -- 172.21.15.5:0/1396657810 learned_addr learned my addr 172.21.15.5:0/1396657810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 10 monclient(hunting): get_auth_request con 0x7f089813f160 auth_method 0 2023-11-01T03:41:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f0896d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f089659c640 10 monclient(hunting): get_auth_request con 0x7f0898071b80 auth_method 0 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f089659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f089659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.892+0000 7f089659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): get_auth_request con 0x7f08980ad330 auth_method 0 2023-11-01T03:41:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.893+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 10 monclient(hunting): handle_auth_done global_id 17405 payload 274 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 -- 172.21.15.5:0/1396657810 >> v2:172.21.15.153:3300/0 conn(0x7f08980ad330 msgr2=0x7f089813ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 --2- 172.21.15.5:0/1396657810 >> v2:172.21.15.153:3300/0 conn(0x7f08980ad330 0x7f089813ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 -- 172.21.15.5:0/1396657810 >> v2:172.21.15.5:3300/0 conn(0x7f0898071b80 msgr2=0x7f08980ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 --2- 172.21.15.5:0/1396657810 >> v2:172.21.15.5:3300/0 conn(0x7f0898071b80 0x7f08980ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 monclient: found mon.noname-b 2023-11-01T03:41:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.894+0000 7f0896d9d640 1 -- 172.21.15.5:0/1396657810 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980aedd0 con 0x7f089813f160 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.897+0000 7f0896d9d640 1 --2- 172.21.15.5:0/1396657810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 secure :-1 s=READY pgs=2902 cs=0 l=1 rev1=1 crypto rx=0x7f08980725c0 tx=0x7f089002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce60b3b923ef02a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 1 -- 172.21.15.5:0/1396657810 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089002ca70 con 0x7f089813f160 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: dump: 2023-11-01T03:41:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 1 -- 172.21.15.5:0/1396657810 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089002cbd0 con 0x7f089813f160 2023-11-01T03:41:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 1 -- 172.21.15.5:0/1396657810 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900343f0 con 0x7f089813f160 2023-11-01T03:41:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089559a640 10 monclient: dump: 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089ca90640 5 monclient: authenticate success, global_id 17405 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089ca90640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.900+0000 7f089ca90640 4 set_mon_vals no callback set 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 10 monclient: shutdown 2023-11-01T03:41:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 -- 172.21.15.5:0/1396657810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 msgr2=0x7f08981450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 --2- 172.21.15.5:0/1396657810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 secure :-1 s=READY pgs=2902 cs=0 l=1 rev1=1 crypto rx=0x7f08980725c0 tx=0x7f089002bed0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 -- 172.21.15.5:0/1396657810 shutdown_connections 2023-11-01T03:41:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 --2- 172.21.15.5:0/1396657810 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981450a0 unknown :-1 s=CLOSED pgs=2902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 --2- 172.21.15.5:0/1396657810 >> v2:172.21.15.153:3300/0 conn(0x7f08980ad330 0x7f089813ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 --2- 172.21.15.5:0/1396657810 >> v2:172.21.15.5:3300/0 conn(0x7f0898071b80 0x7f08980ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 -- 172.21.15.5:0/1396657810 >> 172.21.15.5:0/1396657810 conn(0x7f08980b3600 msgr2=0x7f08980b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 -- 172.21.15.5:0/1396657810 shutdown_connections 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.901+0000 7f089ca90640 1 -- 172.21.15.5:0/1396657810 wait complete. 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 10 monclient: build_initial_monmap 2023-11-01T03:41:15.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 10 monclient: monmap: 2023-11-01T03:41:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 librados: starting msgr at 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 librados: starting objecter 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 Processor -- start 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 -- start start 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 librados: setting wanted keys 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 1 librados: calling monclient init 2023-11-01T03:41:15.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.902+0000 7f089ca90640 10 monclient: init 2023-11-01T03:41:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-01T03:41:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0898071b80 0x7f0898140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-a con 0x7f0898071b80 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 0x7f0898140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-b con 0x7f08980ad330 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): picked mon.noname-c con 0x7f089813f160 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08981d9cd0 con 0x7f0898071b80 2023-11-01T03:41:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08980b2d30 con 0x7f08980ad330 2023-11-01T03:41:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980b0fe0 con 0x7f089813f160 2023-11-01T03:41:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:15.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f089ca90640 10 monclient(hunting): authenticate will time out at 2752.127492s 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.903+0000 7f0896d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 0x7f0898140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f089659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0898071b80 0x7f0898140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981da0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47208/0 (socket says 172.21.15.5:47208) 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 1 -- 172.21.15.5:0/1256469077 learned_addr learned my addr 172.21.15.5:0/1256469077 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:15.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): get_auth_request con 0x7f089813f160 auth_method 0 2023-11-01T03:41:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): get_auth_request con 0x7f08980ad330 auth_method 0 2023-11-01T03:41:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f089659c640 10 monclient(hunting): get_auth_request con 0x7f0898071b80 auth_method 0 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f089659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f089659c640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:15.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f089659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:15.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0896d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.904+0000 7f0895d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.905+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.905+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.905+0000 7f089659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 10 monclient(hunting): handle_auth_done global_id 22243 payload 824 2023-11-01T03:41:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 -- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 msgr2=0x7f08981da0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981da0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 -- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0898071b80 msgr2=0x7f0898140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0898071b80 0x7f0898140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 10 monclient: _finish_hunting 0 2023-11-01T03:41:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 monclient: found mon.noname-b 2023-11-01T03:41:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.907+0000 7f0895d9b640 1 -- 172.21.15.5:0/1256469077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009b30 con 0x7f08980ad330 2023-11-01T03:41:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.909+0000 7f0895d9b640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 0x7f0898140dd0 secure :-1 s=READY pgs=5566 cs=0 l=1 rev1=1 crypto rx=0x7f088c00e820 tx=0x7f088c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.909+0000 7f0886ffd640 10 client.?.objecter ms_handle_connect 0x7f08980ad330 2023-11-01T03:41:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.909+0000 7f0886ffd640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00c940 con 0x7f08980ad330 2023-11-01T03:41:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: dump: 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.933 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.934 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: _finish_auth 0 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: _check_auth_tickets 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00caa0 con 0x7f08980ad330 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f089ca90640 5 monclient: authenticate success, global_id 22243 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f089ca90640 10 monclient: _renew_subs 2023-11-01T03:41:15.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f089ca90640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0898141310 con 0x7f08980ad330 2023-11-01T03:41:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.913+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00ce30 con 0x7f08980ad330 2023-11-01T03:41:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f0886ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f0886ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f0886ffd640 10 monclient: dump: 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:15.938 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:15.938 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f0894d99640 4 set_mon_vals no callback set 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 client.22243.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 monclient: _renew_subs 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08981da810 con 0x7f08980ad330 2023-11-01T03:41:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 1 librados: init done 2023-11-01T03:41:15.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:15.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:15.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.914+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08981daa90 con 0x7f08980ad330 2023-11-01T03:41:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.934+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f088c013470 con 0x7f08980ad330 2023-11-01T03:41:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.934+0000 7f0886ffd640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 0x7f087806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.934+0000 7f089659c640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 0x7f087806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.934+0000 7f089659c640 10 monclient: get_auth_request con 0x7f087806c850 auth_method 0 2023-11-01T03:41:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.935+0000 7f0886ffd640 10 client.22243.objecter ms_handle_connect 0x7f087806c850 2023-11-01T03:41:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:15.935+0000 7f089659c640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 0x7f087806ed10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0888009ac0 tx=0x7f0888009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.173+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f088c058cc0 con 0x7f08980ad330 2023-11-01T03:41:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.173+0000 7f0886ffd640 10 client.22243.objecter ms_dispatch 0x7f0898000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.173+0000 7f0886ffd640 3 client.22243.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.173+0000 7f0886ffd640 3 client.22243.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.173+0000 7f0886ffd640 20 client.22243.objecter dump_active .. 0 homeless 2023-11-01T03:41:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.182+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f088c055000 con 0x7f08980ad330 2023-11-01T03:41:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.182+0000 7f0886ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.182+0000 7f0886ffd640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.382+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f08980b11a0 con 0x7f087806c850 2023-11-01T03:41:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.383+0000 7f0886ffd640 1 -- 172.21.15.5:0/1256469077 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f08980b11a0 con 0x7f087806c850 2023-11-01T03:41:16.384 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2023-11-01T03:41:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.385+0000 7f089ca90640 10 librados: watch_flush enter 2023-11-01T03:41:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 10 librados: watch_flush exit 2023-11-01T03:41:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 20 client.22243.objecter shutdown clearing up homeless session... 2023-11-01T03:41:16.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 10 client.22243.objecter successfully canceled tick 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 msgr2=0x7f087806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 0x7f087806ed10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0888009ac0 tx=0x7f0888009190 comp rx=0 tx=0).stop 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 10 monclient: shutdown 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 msgr2=0x7f0898140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 0x7f0898140dd0 secure :-1 s=READY pgs=5566 cs=0 l=1 rev1=1 crypto rx=0x7f088c00e820 tx=0x7f088c00ece0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 shutdown_connections 2023-11-01T03:41:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f087806c850 0x7f087806ed10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f089813f160 0x7f08981da0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08980ad330 0x7f0898140dd0 unknown :-1 s=CLOSED pgs=5566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 --2- 172.21.15.5:0/1256469077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0898071b80 0x7f0898140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 >> 172.21.15.5:0/1256469077 conn(0x7f08980b3600 msgr2=0x7f0898139bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:16.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 shutdown_connections 2023-11-01T03:41:16.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 -- 172.21.15.5:0/1256469077 wait complete. 2023-11-01T03:41:16.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.386+0000 7f089ca90640 1 librados: shutdown 2023-11-01T03:41:16.400 INFO:tasks.ceph:Scrubbing osd.7 2023-11-01T03:41:16.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-01T03:41:16.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 10 monclient: get_monmap_and_config 2023-11-01T03:41:16.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 10 monclient: build_initial_monmap 2023-11-01T03:41:16.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 10 monclient: monmap: 2023-11-01T03:41:16.511 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:16.511 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.511 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:16.511031+0000 2023-11-01T03:41:16.511 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:16.511031+0000 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:16.513 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:16.513 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 1 Processor -- start 2023-11-01T03:41:16.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 1 -- start start 2023-11-01T03:41:16.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.510+0000 7f472b8d7640 10 monclient: init 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47240b42c0 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-b con 0x7f47240a8770 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:16.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47240a9210 0x7f4724144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-a con 0x7f47240a9210 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:16.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240a8d00 con 0x7f47240b42c0 2023-11-01T03:41:16.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b46a0 con 0x7f47240a9210 2023-11-01T03:41:16.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ade80 con 0x7f47240a8770 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.511+0000 7f472b8d7640 10 monclient(hunting): authenticate will time out at 2752.735463s 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4729e74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47240a9210 0x7f4724144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47210/0 (socket says 172.21.15.5:47210) 2023-11-01T03:41:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 1 -- 172.21.15.5:0/2902555667 learned_addr learned my addr 172.21.15.5:0/2902555667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 10 monclient(hunting): get_auth_request con 0x7f47240a8770 auth_method 0 2023-11-01T03:41:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4728e72640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4729e74640 10 monclient(hunting): get_auth_request con 0x7f47240a9210 auth_method 0 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4729e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4729e74640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.512+0000 7f4729e74640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.513+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 10 monclient(hunting): handle_auth_done global_id 17411 payload 274 2023-11-01T03:41:16.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 1 -- 172.21.15.5:0/2902555667 >> v2:172.21.15.5:3300/0 conn(0x7f47240a9210 msgr2=0x7f4724144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 1 --2- 172.21.15.5:0/2902555667 >> v2:172.21.15.5:3300/0 conn(0x7f47240a9210 0x7f4724144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 1 -- 172.21.15.5:0/2902555667 >> v1:172.21.15.5:6789/0 conn(0x7f47240b42c0 legacy=0x7f472413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 10 monclient: _finish_hunting 0 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 1 monclient: found mon.noname-b 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:16.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:16.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.514+0000 7f4728e72640 1 -- 172.21.15.5:0/2902555667 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47241454a0 con 0x7f47240a8770 2023-11-01T03:41:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.517+0000 7f4728e72640 1 --2- 172.21.15.5:0/2902555667 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 secure :-1 s=READY pgs=2903 cs=0 l=1 rev1=1 crypto rx=0x7f4718009870 tx=0x7f471802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3695528e306983fb server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 1 -- 172.21.15.5:0/2902555667 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180317c0 con 0x7f47240a8770 2023-11-01T03:41:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: dump: 2023-11-01T03:41:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.528 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 1 -- 172.21.15.5:0/2902555667 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718031920 con 0x7f47240a8770 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 1 -- 172.21.15.5:0/2902555667 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718031cb0 con 0x7f47240a8770 2023-11-01T03:41:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 5 monclient: authenticate success, global_id 17411 2023-11-01T03:41:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 4 set_mon_vals no callback set 2023-11-01T03:41:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f4723fff640 10 monclient: dump: 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 10 monclient: shutdown 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.521+0000 7f472b8d7640 1 -- 172.21.15.5:0/2902555667 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 msgr2=0x7f472413f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 --2- 172.21.15.5:0/2902555667 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 secure :-1 s=READY pgs=2903 cs=0 l=1 rev1=1 crypto rx=0x7f4718009870 tx=0x7f471802b860 comp rx=0 tx=0).stop 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 -- 172.21.15.5:0/2902555667 shutdown_connections 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 --2- 172.21.15.5:0/2902555667 >> v2:172.21.15.5:3300/0 conn(0x7f47240a9210 0x7f4724144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 --2- 172.21.15.5:0/2902555667 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a8770 0x7f472413f300 unknown :-1 s=CLOSED pgs=2903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 -- 172.21.15.5:0/2902555667 >> 172.21.15.5:0/2902555667 conn(0x7f4724065ee0 msgr2=0x7f47240662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 -- 172.21.15.5:0/2902555667 shutdown_connections 2023-11-01T03:41:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.522+0000 7f472b8d7640 1 -- 172.21.15.5:0/2902555667 wait complete. 2023-11-01T03:41:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 10 monclient: build_initial_monmap 2023-11-01T03:41:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 10 monclient: monmap: 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:16.536 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 librados: starting msgr at 2023-11-01T03:41:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 librados: starting objecter 2023-11-01T03:41:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 Processor -- start 2023-11-01T03:41:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 -- start start 2023-11-01T03:41:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 librados: setting wanted keys 2023-11-01T03:41:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 1 librados: calling monclient init 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.523+0000 7f472b8d7640 10 monclient: init 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240a8770 0x7f47240b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-b con 0x7f47240a8770 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a9210 0x7f47240b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-c con 0x7f47240a9210 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b42c0 0x7f47240ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): picked mon.noname-a con 0x7f47240b42c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240acb60 con 0x7f47240b42c0 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240accd0 con 0x7f47240a8770 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240b05f0 con 0x7f47240a9210 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f472b8d7640 10 monclient(hunting): authenticate will time out at 2752.748115s 2023-11-01T03:41:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a9210 0x7f47240b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4729e74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b42c0 0x7f47240ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a9210 0x7f47240b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:47220/0 (socket says 172.21.15.5:47220) 2023-11-01T03:41:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 1 -- 172.21.15.5:0/1376313752 learned_addr learned my addr 172.21.15.5:0/1376313752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 10 monclient(hunting): get_auth_request con 0x7f47240a9210 auth_method 0 2023-11-01T03:41:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4728e72640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.524+0000 7f4729673640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240a8770 0x7f47240b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): get_auth_request con 0x7f47240b42c0 auth_method 0 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): get_auth_request con 0x7f47240a8770 auth_method 0 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4728e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.525+0000 7f4729e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 10 monclient(hunting): handle_auth_done global_id 22246 payload 824 2023-11-01T03:41:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 -- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a9210 msgr2=0x7f47240b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f47240a9210 0x7f47240b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 -- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b42c0 msgr2=0x7f47240ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47240b42c0 0x7f47240ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 10 monclient: _finish_hunting 0 2023-11-01T03:41:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 monclient: found mon.noname-b 2023-11-01T03:41:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.528+0000 7f4729673640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180094d0 con 0x7f47240a8770 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.530+0000 7f4729673640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240a8770 0x7f47240b0c10 secure :-1 s=READY pgs=5567 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c390 tx=0x7f471c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.530+0000 7f4721ffb640 10 client.?.objecter ms_handle_connect 0x7f47240a8770 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.530+0000 7f4721ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0052d0 con 0x7f47240a8770 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: dump: 2023-11-01T03:41:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.551 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: _finish_auth 0 2023-11-01T03:41:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:41:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c005430 con 0x7f47240a8770 2023-11-01T03:41:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c003830 con 0x7f47240a8770 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 5 monclient: authenticate success, global_id 22246 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 10 monclient: _renew_subs 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240ae970 con 0x7f47240a8770 2023-11-01T03:41:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f47237fe640 4 set_mon_vals no callback set 2023-11-01T03:41:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f4721ffb640 10 monclient: dump: 2023-11-01T03:41:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 10 client.22246.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 10 monclient: _renew_subs 2023-11-01T03:41:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240aee80 con 0x7f47240a8770 2023-11-01T03:41:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.534+0000 7f472b8d7640 1 librados: init done 2023-11-01T03:41:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 10 client.22246.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 15 client.22246.objecter _session_command_op_assign -1 1 2023-11-01T03:41:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 20 client.22246.objecter _get_session osd=-1 returning homeless 2023-11-01T03:41:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 10 client.22246.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.535+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4724075530 con 0x7f47240a8770 2023-11-01T03:41:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.557+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f471c003990 con 0x7f47240a8770 2023-11-01T03:41:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.557+0000 7f4721ffb640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f471006c850 0x7f471006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.557+0000 7f4728e72640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f471006c850 0x7f471006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.557+0000 7f4728e72640 10 monclient: get_auth_request con 0x7f471006c850 auth_method 0 2023-11-01T03:41:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.558+0000 7f4721ffb640 10 client.22246.objecter ms_handle_connect 0x7f471006c850 2023-11-01T03:41:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.558+0000 7f4728e72640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f471006c850 0x7f471006ed10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47180090b0 tx=0x7f471803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f471c057fc0 con 0x7f47240a8770 2023-11-01T03:41:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 10 client.22246.objecter ms_dispatch 0x7f4724000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 3 client.22246.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 3 client.22246.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 10 client.22246.objecter checking command 1 2023-11-01T03:41:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f47100740b0 0x7f4710076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 20 client.22246.objecter _get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 15 client.22246.objecter _session_command_op_remove -1 1 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 20 client.22246.objecter _get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 20 client.22246.objecter get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 15 client.22246.objecter _session_command_op_assign 7 1 2023-11-01T03:41:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 4 2023-11-01T03:41:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 10 client.22246.objecter _send_command 1 2023-11-01T03:41:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.559+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4710076c20 con 0x7f47100740b0 2023-11-01T03:41:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.560+0000 7f4721ffb640 20 client.22246.objecter dump_active .. 0 homeless 2023-11-01T03:41:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.560+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=902) v2 ==== 24+0+0 (secure 0 0 0) 0x7f471c054300 con 0x7f47240a8770 2023-11-01T03:41:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.560+0000 7f4721ffb640 10 monclient: handle_get_version_reply finishing 1 version 902 2023-11-01T03:41:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.560+0000 7f4729e74640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f47100740b0 0x7f4710076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.561+0000 7f4729e74640 10 monclient: get_auth_request con 0x7f47100740b0 auth_method 0 2023-11-01T03:41:16.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.563+0000 7f4721ffb640 10 client.22246.objecter ms_handle_connect 0x7f47100740b0 2023-11-01T03:41:16.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.563+0000 7f4729e74640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f47100740b0 0x7f4710076550 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.587+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== osd.7 v2:172.21.15.153:6808/1714004960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4710076c20 con 0x7f47100740b0 2023-11-01T03:41:16.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.587+0000 7f4721ffb640 10 client.22246.objecter ms_dispatch 0x7f4724000b90 command_reply(tid 1: 0 ) v1 2023-11-01T03:41:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.587+0000 7f4721ffb640 10 client.22246.objecter _finish_command 1 = system:0 2023-11-01T03:41:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.587+0000 7f4721ffb640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 4 2023-11-01T03:41:16.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.587+0000 7f4721ffb640 15 client.22246.objecter _session_command_op_remove 7 1 2023-11-01T03:41:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 10 client.22246.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-01T03:41:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 15 client.22246.objecter _session_command_op_assign -1 2 2023-11-01T03:41:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 20 client.22246.objecter _get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 20 client.22246.objecter _get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 15 client.22246.objecter _session_command_op_remove -1 2 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 20 client.22246.objecter get_session s=0x7f47100739e0 osd=7 3 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 15 client.22246.objecter _session_command_op_assign 7 2 2023-11-01T03:41:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 4 2023-11-01T03:41:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 10 client.22246.objecter _send_command 2 2023-11-01T03:41:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.599+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 --> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f47240b2f90 con 0x7f47100740b0 2023-11-01T03:41:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4721ffb640 1 -- 172.21.15.5:0/1376313752 <== osd.7 v2:172.21.15.153:6808/1714004960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f47240b2f90 con 0x7f47100740b0 2023-11-01T03:41:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4721ffb640 10 client.22246.objecter ms_dispatch 0x7f4724000b90 command_reply(tid 2: 0 ) v1 2023-11-01T03:41:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4721ffb640 10 client.22246.objecter _finish_command 2 = system:0 2023-11-01T03:41:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4721ffb640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 4 2023-11-01T03:41:16.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4721ffb640 15 client.22246.objecter _session_command_op_remove 7 2 2023-11-01T03:41:16.616 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-11-01T03:41:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-01T03:41:16.616 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-11-01T03:41:16.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 10 librados: watch_flush enter 2023-11-01T03:41:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 10 librados: watch_flush exit 2023-11-01T03:41:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 10 client.22246.objecter close_session for osd.7 2023-11-01T03:41:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f47100740b0 msgr2=0x7f4710076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:6808/1714004960,v1:172.21.15.153:6809/1714004960] conn(0x7f47100740b0 0x7f4710076550 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 20 client.22246.objecter put_session s=0x7f47100739e0 osd=7 1 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 20 client.22246.objecter shutdown clearing up homeless session... 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 10 client.22246.objecter successfully canceled tick 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f471006c850 msgr2=0x7f471006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f471006c850 0x7f471006ed10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47180090b0 tx=0x7f471803d040 comp rx=0 tx=0).stop 2023-11-01T03:41:16.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 10 monclient: shutdown 2023-11-01T03:41:16.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:16.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240a8770 msgr2=0x7f47240b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 --2- 172.21.15.5:0/1376313752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47240a8770 0x7f47240b0c10 secure :-1 s=READY pgs=5567 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c390 tx=0x7f471c00c850 comp rx=0 tx=0).stop 2023-11-01T03:41:16.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f4729e74640 1 -- 172.21.15.5:0/1376313752 reap_dead start 2023-11-01T03:41:16.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 shutdown_connections 2023-11-01T03:41:16.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 >> 172.21.15.5:0/1376313752 conn(0x7f4724065ee0 msgr2=0x7f472413e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:16.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 shutdown_connections 2023-11-01T03:41:16.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 -- 172.21.15.5:0/1376313752 wait complete. 2023-11-01T03:41:16.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.614+0000 7f472b8d7640 1 librados: shutdown 2023-11-01T03:41:16.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-01T03:41:16.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.735+0000 7ffa46090640 10 monclient: get_monmap_and_config 2023-11-01T03:41:16.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.735+0000 7ffa46090640 10 monclient: build_initial_monmap 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.735+0000 7ffa46090640 10 monclient: monmap: 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:16.736788+0000 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:16.736788+0000 2023-11-01T03:41:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:16.739 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.736+0000 7ffa46090640 1 Processor -- start 2023-11-01T03:41:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.736+0000 7ffa46090640 1 -- start start 2023-11-01T03:41:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.736+0000 7ffa46090640 10 monclient: init 2023-11-01T03:41:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2023-11-01T03:41:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffa4006bbe0 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffa4006b1d0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 0x7ffa40141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-b con 0x7ffa40071ac0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4006c790 con 0x7ffa4006bbe0 2023-11-01T03:41:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa40072160 con 0x7ffa4006b1d0 2023-11-01T03:41:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40142230 con 0x7ffa40071ac0 2023-11-01T03:41:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa46090640 10 monclient(hunting): authenticate will time out at 2752.961259s 2023-11-01T03:41:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.737+0000 7ffa3ffff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 0x7ffa40141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa4006bbe0 0x7ffa4006bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38846/0 (socket says 172.21.15.5:38846) 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3f7fe640 1 -- 172.21.15.5:0/2507745382 learned_addr learned my addr 172.21.15.5:0/2507745382 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): get_auth_request con 0x7ffa40071ac0 auth_method 0 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.738+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 1 -- 172.21.15.5:0/2507745382 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726271630 0 0) 0x7ffa40072160 con 0x7ffa4006b1d0 2023-11-01T03:41:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 10 monclient(hunting): _negotiate 2023-11-01T03:41:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 10 monclient(hunting): my global_id is 22249 2023-11-01T03:41:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.740+0000 7ffa3e7fc640 1 -- 172.21.15.5:0/2507745382 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa28003520 con 0x7ffa4006b1d0 2023-11-01T03:41:16.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_done global_id 17417 payload 274 2023-11-01T03:41:16.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 1 -- 172.21.15.5:0/2507745382 >> v1:172.21.15.153:6789/0 conn(0x7ffa4006b1d0 legacy=0x7ffa400713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 1 -- 172.21.15.5:0/2507745382 >> v1:172.21.15.5:6789/0 conn(0x7ffa4006bbe0 legacy=0x7ffa4006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 1 monclient: found mon.noname-b 2023-11-01T03:41:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.741+0000 7ffa3ffff640 1 -- 172.21.15.5:0/2507745382 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40142370 con 0x7ffa40071ac0 2023-11-01T03:41:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.743+0000 7ffa3ffff640 1 --2- 172.21.15.5:0/2507745382 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 0x7ffa40141cf0 secure :-1 s=READY pgs=2904 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009df0 tx=0x7ffa3802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639653fbb66fa798 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 1 -- 172.21.15.5:0/2507745382 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3802cc20 con 0x7ffa40071ac0 2023-11-01T03:41:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: dump: 2023-11-01T03:41:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.757 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 1 -- 172.21.15.5:0/2507745382 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3802cd80 con 0x7ffa40071ac0 2023-11-01T03:41:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 1 -- 172.21.15.5:0/2507745382 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38034660 con 0x7ffa40071ac0 2023-11-01T03:41:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 5 monclient: authenticate success, global_id 17417 2023-11-01T03:41:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 4 set_mon_vals no callback set 2023-11-01T03:41:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa3e7fc640 10 monclient: dump: 2023-11-01T03:41:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.763 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.763 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.763 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.764 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.764 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.764 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 10 monclient: shutdown 2023-11-01T03:41:16.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:16.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 1 -- 172.21.15.5:0/2507745382 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 msgr2=0x7ffa40141cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 1 --2- 172.21.15.5:0/2507745382 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 0x7ffa40141cf0 secure :-1 s=READY pgs=2904 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009df0 tx=0x7ffa3802be70 comp rx=0 tx=0).stop 2023-11-01T03:41:16.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 1 -- 172.21.15.5:0/2507745382 shutdown_connections 2023-11-01T03:41:16.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 1 --2- 172.21.15.5:0/2507745382 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa40071ac0 0x7ffa40141cf0 unknown :-1 s=CLOSED pgs=2904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.747+0000 7ffa46090640 1 -- 172.21.15.5:0/2507745382 >> 172.21.15.5:0/2507745382 conn(0x7ffa400665e0 msgr2=0x7ffa400b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 1 -- 172.21.15.5:0/2507745382 shutdown_connections 2023-11-01T03:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 1 -- 172.21.15.5:0/2507745382 wait complete. 2023-11-01T03:41:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 10 monclient: build_initial_monmap 2023-11-01T03:41:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 10 monclient: monmap: 2023-11-01T03:41:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:16.770 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 1 librados: starting msgr at 2023-11-01T03:41:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.748+0000 7ffa46090640 1 librados: starting objecter 2023-11-01T03:41:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 Processor -- start 2023-11-01T03:41:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 -- start start 2023-11-01T03:41:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 librados: setting wanted keys 2023-11-01T03:41:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 librados: calling monclient init 2023-11-01T03:41:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient: init 2023-11-01T03:41:16.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 0x7ffa400abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-c con 0x7ffa4006b1d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa4006bbe0 0x7ffa400a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-a con 0x7ffa4006bbe0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:16.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 0x7ffa400aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): picked mon.noname-b con 0x7ffa40071ac0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40139590 con 0x7ffa4006bbe0 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400ab520 con 0x7ffa40071ac0 2023-11-01T03:41:16.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400a8ff0 con 0x7ffa4006b1d0 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.749+0000 7ffa46090640 10 monclient(hunting): authenticate will time out at 2752.973821s 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 0x7ffa400abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa4006bbe0 0x7ffa400a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 0x7ffa400abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48446/0 (socket says 172.21.15.5:48446) 2023-11-01T03:41:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 1 -- 172.21.15.5:0/84024796 learned_addr learned my addr 172.21.15.5:0/84024796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 10 monclient(hunting): get_auth_request con 0x7ffa4006b1d0 auth_method 0 2023-11-01T03:41:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3ffff640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 0x7ffa400aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3effd640 10 monclient(hunting): get_auth_request con 0x7ffa4006bbe0 auth_method 0 2023-11-01T03:41:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3effd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.750+0000 7ffa3effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): get_auth_request con 0x7ffa40071ac0 auth_method 0 2023-11-01T03:41:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.751+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 10 monclient(hunting): handle_auth_done global_id 22252 payload 824 2023-11-01T03:41:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 -- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 msgr2=0x7ffa400abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 0x7ffa400abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 -- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa4006bbe0 msgr2=0x7ffa400a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa4006bbe0 0x7ffa400a9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 monclient: found mon.noname-b 2023-11-01T03:41:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.754+0000 7ffa3ffff640 1 -- 172.21.15.5:0/84024796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38009a70 con 0x7ffa40071ac0 2023-11-01T03:41:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.756+0000 7ffa3ffff640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 0x7ffa400aa110 secure :-1 s=READY pgs=5569 cs=0 l=1 rev1=1 crypto rx=0x7ffa4006b160 tx=0x7ffa38004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.756+0000 7ffa27fff640 10 client.?.objecter ms_handle_connect 0x7ffa40071ac0 2023-11-01T03:41:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.756+0000 7ffa27fff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38040650 con 0x7ffa40071ac0 2023-11-01T03:41:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: dump: 2023-11-01T03:41:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.786 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa380407b0 con 0x7ffa40071ac0 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 5 monclient: authenticate success, global_id 22252 2023-11-01T03:41:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 10 monclient: _renew_subs 2023-11-01T03:41:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38040b60 con 0x7ffa40071ac0 2023-11-01T03:41:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa400aec70 con 0x7ffa40071ac0 2023-11-01T03:41:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa27fff640 10 monclient: dump: 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa3d7fa640 4 set_mon_vals no callback set 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 10 client.22252.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 10 monclient: _renew_subs 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa401386d0 con 0x7ffa40071ac0 2023-11-01T03:41:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.760+0000 7ffa46090640 1 librados: init done 2023-11-01T03:41:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.761+0000 7ffa46090640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.761+0000 7ffa46090640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:16.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.761+0000 7ffa46090640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:16.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.761+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa400ab360 con 0x7ffa40071ac0 2023-11-01T03:41:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.785+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa38040cc0 con 0x7ffa40071ac0 2023-11-01T03:41:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.786+0000 7ffa27fff640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 0x7ffa2c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.786+0000 7ffa3f7fe640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 0x7ffa2c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.786+0000 7ffa3f7fe640 10 monclient: get_auth_request con 0x7ffa2c06c850 auth_method 0 2023-11-01T03:41:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.786+0000 7ffa3f7fe640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 0x7ffa2c06ed10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffa30005880 tx=0x7ffa30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:16.786+0000 7ffa27fff640 10 client.22252.objecter ms_handle_connect 0x7ffa2c06c850 2023-11-01T03:41:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.014+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ffa3807b440 con 0x7ffa40071ac0 2023-11-01T03:41:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.014+0000 7ffa27fff640 10 client.22252.objecter ms_dispatch 0x7ffa40000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.015+0000 7ffa27fff640 3 client.22252.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.015+0000 7ffa27fff640 3 client.22252.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.015+0000 7ffa27fff640 20 client.22252.objecter dump_active .. 0 homeless 2023-11-01T03:41:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.026+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa38077780 con 0x7ffa40071ac0 2023-11-01T03:41:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.026+0000 7ffa27fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.026+0000 7ffa27fff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.206+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4004e9f0 con 0x7ffa2c06c850 2023-11-01T03:41:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.206+0000 7ffa27fff640 1 -- 172.21.15.5:0/84024796 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffa4004e9f0 con 0x7ffa2c06c850 2023-11-01T03:41:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2023-11-01T03:41:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 10 librados: watch_flush enter 2023-11-01T03:41:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 10 librados: watch_flush exit 2023-11-01T03:41:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 20 client.22252.objecter shutdown clearing up homeless session... 2023-11-01T03:41:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 10 client.22252.objecter successfully canceled tick 2023-11-01T03:41:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 msgr2=0x7ffa2c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 0x7ffa2c06ed10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffa30005880 tx=0x7ffa30009040 comp rx=0 tx=0).stop 2023-11-01T03:41:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 10 monclient: shutdown 2023-11-01T03:41:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 msgr2=0x7ffa400aa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 0x7ffa400aa110 secure :-1 s=READY pgs=5569 cs=0 l=1 rev1=1 crypto rx=0x7ffa4006b160 tx=0x7ffa38004a40 comp rx=0 tx=0).stop 2023-11-01T03:41:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 shutdown_connections 2023-11-01T03:41:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7ffa2c06c850 0x7ffa2c06ed10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa40071ac0 0x7ffa400aa110 unknown :-1 s=CLOSED pgs=5569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa4006bbe0 0x7ffa400a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 --2- 172.21.15.5:0/84024796 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ffa4006b1d0 0x7ffa400abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 >> 172.21.15.5:0/84024796 conn(0x7ffa400665e0 msgr2=0x7ffa4013eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 shutdown_connections 2023-11-01T03:41:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 -- 172.21.15.5:0/84024796 wait complete. 2023-11-01T03:41:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.208+0000 7ffa46090640 1 librados: shutdown 2023-11-01T03:41:17.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.325+0000 7fb62ebcc640 10 monclient: get_monmap_and_config 2023-11-01T03:41:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.325+0000 7fb62ebcc640 10 monclient: build_initial_monmap 2023-11-01T03:41:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.325+0000 7fb62ebcc640 10 monclient: monmap: 2023-11-01T03:41:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:17.326311+0000 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:17.326311+0000 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:17.328 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 Processor -- start 2023-11-01T03:41:17.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 -- start start 2023-11-01T03:41:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient: init 2023-11-01T03:41:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2023-11-01T03:41:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb6280b4240 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 0x7fb6280ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-b con 0x7fb6280b38d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb6280ade00 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280b0cc0 con 0x7fb6280b4240 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280aeb80 con 0x7fb6280ade00 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280b4620 con 0x7fb6280b38d0 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.326+0000 7fb62ebcc640 10 monclient(hunting): authenticate will time out at 2753.550921s 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb627fff640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 0x7fb6280ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb62d169640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb6280ade00 0x7fb62813b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.5:46924/0 (socket says 172.21.15.5:46924) 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb62d169640 1 -- 172.21.15.5:0/264066885 learned_addr learned my addr 172.21.15.5:0/264066885 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-11-01T03:41:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb627fff640 10 monclient(hunting): get_auth_request con 0x7fb6280b38d0 auth_method 0 2023-11-01T03:41:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb627fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb627fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.327+0000 7fb627fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.328+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.328+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.328+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 10 monclient(hunting): handle_auth_done global_id 17423 payload 274 2023-11-01T03:41:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 1 -- 172.21.15.5:0/264066885 >> v1:172.21.15.153:6789/0 conn(0x7fb6280ade00 legacy=0x7fb62813b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 1 -- 172.21.15.5:0/264066885 >> v1:172.21.15.5:6789/0 conn(0x7fb6280b4240 legacy=0x7fb6280b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 1 monclient: found mon.noname-b 2023-11-01T03:41:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.330+0000 7fb627fff640 1 -- 172.21.15.5:0/264066885 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62813f5f0 con 0x7fb6280b38d0 2023-11-01T03:41:17.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.332+0000 7fb627fff640 1 --2- 172.21.15.5:0/264066885 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 0x7fb6280ae640 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097d0 tx=0x7fb61802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103a7cb51eb8fd9e server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.337+0000 7fb6277fe640 1 -- 172.21.15.5:0/264066885 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618031800 con 0x7fb6280b38d0 2023-11-01T03:41:17.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.337+0000 7fb6277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.337+0000 7fb6277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.337+0000 7fb6277fe640 10 monclient: dump: 2023-11-01T03:41:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:17.341 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: _finish_auth 0 2023-11-01T03:41:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: _check_auth_tickets 2023-11-01T03:41:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 1 -- 172.21.15.5:0/264066885 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618031960 con 0x7fb6280b38d0 2023-11-01T03:41:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 1 -- 172.21.15.5:0/264066885 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618031cf0 con 0x7fb6280b38d0 2023-11-01T03:41:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 5 monclient: authenticate success, global_id 17423 2023-11-01T03:41:17.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 4 set_mon_vals no callback set 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb6277fe640 10 monclient: dump: 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.344 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:17.345 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 10 monclient: shutdown 2023-11-01T03:41:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 -- 172.21.15.5:0/264066885 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 msgr2=0x7fb6280ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/264066885 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 0x7fb6280ae640 secure :-1 s=READY pgs=2905 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097d0 tx=0x7fb61802b8a0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 -- 172.21.15.5:0/264066885 shutdown_connections 2023-11-01T03:41:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/264066885 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280b38d0 0x7fb6280ae640 unknown :-1 s=CLOSED pgs=2905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 -- 172.21.15.5:0/264066885 >> 172.21.15.5:0/264066885 conn(0x7fb628065cd0 msgr2=0x7fb6280660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:17.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 -- 172.21.15.5:0/264066885 shutdown_connections 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.338+0000 7fb62ebcc640 1 -- 172.21.15.5:0/264066885 wait complete. 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.339+0000 7fb62ebcc640 10 monclient: build_initial_monmap 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.339+0000 7fb62ebcc640 10 monclient: monmap: 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 librados: starting msgr at 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 librados: starting objecter 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 Processor -- start 2023-11-01T03:41:17.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 -- start start 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 librados: setting wanted keys 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 1 librados: calling monclient init 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.340+0000 7fb62ebcc640 10 monclient: init 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:17.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-c con 0x7fb6280ade00 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6280b4240 0x7fb628145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-b con 0x7fb6280b4240 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6281310c0 0x7fb628131550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:17.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): picked mon.noname-a con 0x7fb6281310c0 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628144f00 con 0x7fb6281310c0 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628144060 con 0x7fb6280b4240 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb628145130 con 0x7fb6280ade00 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62ebcc640 10 monclient(hunting): authenticate will time out at 2753.565415s 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.341+0000 7fb62c968640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:48464/0 (socket says 172.21.15.5:48464) 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 1 -- 172.21.15.5:0/2598998843 learned_addr learned my addr 172.21.15.5:0/2598998843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): get_auth_request con 0x7fb6280ade00 auth_method 0 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb627fff640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6280b4240 0x7fb628145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb627fff640 10 monclient(hunting): get_auth_request con 0x7fb6280b4240 auth_method 0 2023-11-01T03:41:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb627fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb627fff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb627fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.342+0000 7fb62c968640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.343+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.343+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.343+0000 7fb627fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 10 monclient(hunting): handle_auth_done global_id 17426 payload 824 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 -- 172.21.15.5:0/2598998843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6280b4240 msgr2=0x7fb628145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6280b4240 0x7fb628145830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 -- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6281310c0 msgr2=0x7fb628131550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6281310c0 0x7fb628131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 10 monclient: _finish_hunting 0 2023-11-01T03:41:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 monclient: found mon.noname-c 2023-11-01T03:41:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.5:3301/0 2023-11-01T03:41:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.345+0000 7fb62c968640 1 -- 172.21.15.5:0/2598998843 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009400 con 0x7fb6280ade00 2023-11-01T03:41:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.347+0000 7fb62c968640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c400 tx=0x7fb61000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.347+0000 7fb6257fa640 10 client.?.objecter ms_handle_connect 0x7fb6280ade00 2023-11-01T03:41:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.347+0000 7fb6257fa640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100052d0 con 0x7fb6280ade00 2023-11-01T03:41:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-01T03:41:17.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: dump: 2023-11-01T03:41:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.364 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: _finish_auth 0 2023-11-01T03:41:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: _check_auth_tickets 2023-11-01T03:41:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610005430 con 0x7fb6280ade00 2023-11-01T03:41:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 5 monclient: authenticate success, global_id 17426 2023-11-01T03:41:17.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 10 monclient: _renew_subs 2023-11-01T03:41:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628145470 con 0x7fb6280ade00 2023-11-01T03:41:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610003830 con 0x7fb6280ade00 2023-11-01T03:41:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb6257fa640 10 monclient: dump: 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.368 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:17.369 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:17.370 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 10 client.17426.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 10 monclient: _renew_subs 2023-11-01T03:41:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb626ffd640 4 set_mon_vals no callback set 2023-11-01T03:41:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62813e550 con 0x7fb6280ade00 2023-11-01T03:41:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.351+0000 7fb62ebcc640 1 librados: init done 2023-11-01T03:41:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.352+0000 7fb62ebcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.352+0000 7fb62ebcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.352+0000 7fb62ebcc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.5:3301/0 2023-11-01T03:41:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.352+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6281441d0 con 0x7fb6280ade00 2023-11-01T03:41:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.679+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb610003990 con 0x7fb6280ade00 2023-11-01T03:41:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.679+0000 7fb6257fa640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 0x7fb60806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.680+0000 7fb627fff640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 0x7fb60806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.680+0000 7fb627fff640 10 monclient: get_auth_request con 0x7fb60806c800 auth_method 0 2023-11-01T03:41:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.680+0000 7fb627fff640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 0x7fb60806ecc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb618036000 tx=0x7fb61803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.680+0000 7fb6257fa640 10 client.17426.objecter ms_handle_connect 0x7fb60806c800 2023-11-01T03:41:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.694+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fb610057db0 con 0x7fb6280ade00 2023-11-01T03:41:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.694+0000 7fb6257fa640 10 client.17426.objecter ms_dispatch 0x7fb628000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.694+0000 7fb6257fa640 3 client.17426.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.694+0000 7fb6257fa640 3 client.17426.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.694+0000 7fb6257fa640 20 client.17426.objecter dump_active .. 0 homeless 2023-11-01T03:41:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.695+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mon.2 v2:172.21.15.5:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6100540f0 con 0x7fb6280ade00 2023-11-01T03:41:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.695+0000 7fb6257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.695+0000 7fb6257fa640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:17.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.881+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb62804e9f0 con 0x7fb60806c800 2023-11-01T03:41:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.885+0000 7fb6257fa640 1 -- 172.21.15.5:0/2598998843 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151184 (secure 0 0 0) 0x7fb62804e9f0 con 0x7fb60806c800 2023-11-01T03:41:17.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 10 librados: watch_flush enter 2023-11-01T03:41:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 10 librados: watch_flush exit 2023-11-01T03:41:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 20 client.17426.objecter shutdown clearing up homeless session... 2023-11-01T03:41:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 10 client.17426.objecter successfully canceled tick 2023-11-01T03:41:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 msgr2=0x7fb60806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 0x7fb60806ecc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb618036000 tx=0x7fb61803c040 comp rx=0 tx=0).stop 2023-11-01T03:41:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 10 monclient: shutdown 2023-11-01T03:41:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 msgr2=0x7fb6281439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 secure :-1 s=READY pgs=2906 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c400 tx=0x7fb61000c8c0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 shutdown_connections 2023-11-01T03:41:17.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7fb60806c800 0x7fb60806ecc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6281310c0 0x7fb628131550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6280b4240 0x7fb628145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 --2- 172.21.15.5:0/2598998843 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7fb6280ade00 0x7fb6281439d0 unknown :-1 s=CLOSED pgs=2906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 >> 172.21.15.5:0/2598998843 conn(0x7fb628065cd0 msgr2=0x7fb6280b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:17.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 shutdown_connections 2023-11-01T03:41:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 -- 172.21.15.5:0/2598998843 wait complete. 2023-11-01T03:41:17.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:17.888+0000 7fb62ebcc640 1 librados: shutdown 2023-11-01T03:41:17.900 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1576,"stamp":"2023-11-01T03:41:17.511218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":554840,"kb_used_data":43032,"kb_used_omap":12,"kb_used_meta":511667,"kb_avail":754419880,"statfs":{"total":773094113280,"available":772525957120,"internally_reserved":0,"allocated":44064768,"data_stored":23660274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":523947577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.315773"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":857,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.769334+0000","last_change":"2023-11-01T03:20:28.999446+0000","last_active":"2023-11-01T03:41:05.769334+0000","last_peered":"2023-11-01T03:41:05.769334+0000","last_clean":"2023-11-01T03:41:05.769334+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:05.769334+0000","last_undegraded":"2023-11-01T03:41:05.769334+0000","last_fullsized":"2023-11-01T03:41:05.769334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:52:15.750885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":865,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.714426+0000","last_change":"2023-11-01T03:20:21.292351+0000","last_active":"2023-11-01T03:41:05.714426+0000","last_peered":"2023-11-01T03:41:05.714426+0000","last_clean":"2023-11-01T03:41:05.714426+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:05.714426+0000","last_undegraded":"2023-11-01T03:41:05.714426+0000","last_fullsized":"2023-11-01T03:41:05.714426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:56:45.398675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":853,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.495113+0000","last_change":"2023-11-01T03:20:24.849514+0000","last_active":"2023-11-01T03:41:06.495113+0000","last_peered":"2023-11-01T03:41:06.495113+0000","last_clean":"2023-11-01T03:41:06.495113+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:06.495113+0000","last_undegraded":"2023-11-01T03:41:06.495113+0000","last_fullsized":"2023-11-01T03:41:06.495113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":854,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.228746+0000","last_change":"2023-11-01T03:20:28.961484+0000","last_active":"2023-11-01T03:41:06.228746+0000","last_peered":"2023-11-01T03:41:06.228746+0000","last_clean":"2023-11-01T03:41:06.228746+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:06.228746+0000","last_undegraded":"2023-11-01T03:41:06.228746+0000","last_fullsized":"2023-11-01T03:41:06.228746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":858,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.222791+0000","last_change":"2023-11-01T03:20:14.753917+0000","last_active":"2023-11-01T03:41:06.222791+0000","last_peered":"2023-11-01T03:41:06.222791+0000","last_clean":"2023-11-01T03:41:06.222791+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:06.222791+0000","last_undegraded":"2023-11-01T03:41:06.222791+0000","last_fullsized":"2023-11-01T03:41:06.222791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:16:48.817140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":854,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:12.049490+0000","last_change":"2023-11-01T03:20:19.035194+0000","last_active":"2023-11-01T03:41:12.049490+0000","last_peered":"2023-11-01T03:41:12.049490+0000","last_clean":"2023-11-01T03:41:12.049490+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:12.049490+0000","last_undegraded":"2023-11-01T03:41:12.049490+0000","last_fullsized":"2023-11-01T03:41:12.049490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":855,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.482078+0000","last_change":"2023-11-01T03:21:04.928879+0000","last_active":"2023-11-01T03:41:06.482078+0000","last_peered":"2023-11-01T03:41:06.482078+0000","last_clean":"2023-11-01T03:41:06.482078+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:06.482078+0000","last_undegraded":"2023-11-01T03:41:06.482078+0000","last_fullsized":"2023-11-01T03:41:06.482078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.836598+0000","last_change":"2023-11-01T03:41:15.836598+0000","last_active":"2023-11-01T03:41:15.836598+0000","last_peered":"2023-11-01T03:41:15.836598+0000","last_clean":"2023-11-01T03:41:15.836598+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:15.836598+0000","last_undegraded":"2023-11-01T03:41:15.836598+0000","last_fullsized":"2023-11-01T03:41:15.836598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_clean_scrub_stamp":"2023-11-01T03:41:15.834047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:23:54.174101+0000","scrub_duration":0.045577138000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":868,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.571278+0000","last_change":"2023-11-01T03:20:21.310132+0000","last_active":"2023-11-01T03:41:05.571278+0000","last_peered":"2023-11-01T03:41:05.571278+0000","last_clean":"2023-11-01T03:41:05.571278+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:05.571278+0000","last_undegraded":"2023-11-01T03:41:05.571278+0000","last_fullsized":"2023-11-01T03:41:05.571278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:50:11.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":865,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.715977+0000","last_change":"2023-11-01T03:20:21.284659+0000","last_active":"2023-11-01T03:41:05.715977+0000","last_peered":"2023-11-01T03:41:05.715977+0000","last_clean":"2023-11-01T03:41:05.715977+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:05.715977+0000","last_undegraded":"2023-11-01T03:41:05.715977+0000","last_fullsized":"2023-11-01T03:41:05.715977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:27:21.187272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":870,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.576334+0000","last_change":"2023-11-01T03:20:24.027089+0000","last_active":"2023-11-01T03:41:05.576334+0000","last_peered":"2023-11-01T03:41:05.576334+0000","last_clean":"2023-11-01T03:41:05.576334+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:05.576334+0000","last_undegraded":"2023-11-01T03:41:05.576334+0000","last_fullsized":"2023-11-01T03:41:05.576334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:29:01.442024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":870,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.574213+0000","last_change":"2023-11-01T03:20:25.928340+0000","last_active":"2023-11-01T03:41:05.574213+0000","last_peered":"2023-11-01T03:41:05.574213+0000","last_clean":"2023-11-01T03:41:05.574213+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:05.574213+0000","last_undegraded":"2023-11-01T03:41:05.574213+0000","last_fullsized":"2023-11-01T03:41:05.574213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:44:04.520733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":854,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.750013+0000","last_change":"2023-11-01T03:20:21.132613+0000","last_active":"2023-11-01T03:41:05.750013+0000","last_peered":"2023-11-01T03:41:05.750013+0000","last_clean":"2023-11-01T03:41:05.750013+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:05.750013+0000","last_undegraded":"2023-11-01T03:41:05.750013+0000","last_fullsized":"2023-11-01T03:41:05.750013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:14:39.509557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":863,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.765751+0000","last_change":"2023-11-01T03:19:09.868042+0000","last_active":"2023-11-01T03:41:05.765751+0000","last_peered":"2023-11-01T03:41:05.765751+0000","last_clean":"2023-11-01T03:41:05.765751+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:05.765751+0000","last_undegraded":"2023-11-01T03:41:05.765751+0000","last_fullsized":"2023-11-01T03:41:05.765751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:33:40.755133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":858,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.770999+0000","last_change":"2023-11-01T03:20:20.628315+0000","last_active":"2023-11-01T03:41:05.770999+0000","last_peered":"2023-11-01T03:41:05.770999+0000","last_clean":"2023-11-01T03:41:05.770999+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:05.770999+0000","last_undegraded":"2023-11-01T03:41:05.770999+0000","last_fullsized":"2023-11-01T03:41:05.770999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:13:44.355143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":859,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.494025+0000","last_change":"2023-11-01T03:19:09.899947+0000","last_active":"2023-11-01T03:41:06.494025+0000","last_peered":"2023-11-01T03:41:06.494025+0000","last_clean":"2023-11-01T03:41:06.494025+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:06.494025+0000","last_undegraded":"2023-11-01T03:41:06.494025+0000","last_fullsized":"2023-11-01T03:41:06.494025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":856,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.486519+0000","last_change":"2023-11-01T03:20:22.257051+0000","last_active":"2023-11-01T03:41:06.486519+0000","last_peered":"2023-11-01T03:41:06.486519+0000","last_clean":"2023-11-01T03:41:06.486519+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:06.486519+0000","last_undegraded":"2023-11-01T03:41:06.486519+0000","last_fullsized":"2023-11-01T03:41:06.486519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":863,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.772666+0000","last_change":"2023-11-01T03:19:09.159240+0000","last_active":"2023-11-01T03:41:05.772666+0000","last_peered":"2023-11-01T03:41:05.772666+0000","last_clean":"2023-11-01T03:41:05.772666+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:05.772666+0000","last_undegraded":"2023-11-01T03:41:05.772666+0000","last_fullsized":"2023-11-01T03:41:05.772666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:08.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":854,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.496781+0000","last_change":"2023-11-01T03:20:24.831827+0000","last_active":"2023-11-01T03:41:06.496781+0000","last_peered":"2023-11-01T03:41:06.496781+0000","last_clean":"2023-11-01T03:41:06.496781+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:06.496781+0000","last_undegraded":"2023-11-01T03:41:06.496781+0000","last_fullsized":"2023-11-01T03:41:06.496781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":871,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.717753+0000","last_change":"2023-11-01T03:19:09.803702+0000","last_active":"2023-11-01T03:41:05.717753+0000","last_peered":"2023-11-01T03:41:05.717753+0000","last_clean":"2023-11-01T03:41:05.717753+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:05.717753+0000","last_undegraded":"2023-11-01T03:41:05.717753+0000","last_fullsized":"2023-11-01T03:41:05.717753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:04:48.123170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":866,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.698240+0000","last_change":"2023-11-01T03:20:38.569214+0000","last_active":"2023-11-01T03:41:05.698240+0000","last_peered":"2023-11-01T03:41:05.698240+0000","last_clean":"2023-11-01T03:41:05.698240+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:05.698240+0000","last_undegraded":"2023-11-01T03:41:05.698240+0000","last_fullsized":"2023-11-01T03:41:05.698240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:01:54.979113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":863,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.740265+0000","last_change":"2023-11-01T03:19:09.776611+0000","last_active":"2023-11-01T03:41:05.740265+0000","last_peered":"2023-11-01T03:41:05.740265+0000","last_clean":"2023-11-01T03:41:05.740265+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:05.740265+0000","last_undegraded":"2023-11-01T03:41:05.740265+0000","last_fullsized":"2023-11-01T03:41:05.740265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:01:54.493912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:13.922300+0000","last_change":"2023-11-01T03:41:13.923450+0000","last_active":"2023-11-01T03:41:13.922300+0000","last_peered":"2023-11-01T03:41:13.922300+0000","last_clean":"2023-11-01T03:41:13.922300+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:13.922300+0000","last_undegraded":"2023-11-01T03:41:13.922300+0000","last_fullsized":"2023-11-01T03:41:13.922300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_clean_scrub_stamp":"2023-11-01T03:41:13.920800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:15:49.893573+0000","scrub_duration":0.074463761000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":859,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.745031+0000","last_change":"2023-11-01T03:19:08.997431+0000","last_active":"2023-11-01T03:41:05.745031+0000","last_peered":"2023-11-01T03:41:05.745031+0000","last_clean":"2023-11-01T03:41:05.745031+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:05.745031+0000","last_undegraded":"2023-11-01T03:41:05.745031+0000","last_fullsized":"2023-11-01T03:41:05.745031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:27:58.990793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":866,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.703803+0000","last_change":"2023-11-01T03:20:27.836705+0000","last_active":"2023-11-01T03:41:05.703803+0000","last_peered":"2023-11-01T03:41:05.703803+0000","last_clean":"2023-11-01T03:41:05.703803+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:05.703803+0000","last_undegraded":"2023-11-01T03:41:05.703803+0000","last_fullsized":"2023-11-01T03:41:05.703803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:24:51.036742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":863,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.743990+0000","last_change":"2023-11-01T03:19:09.103306+0000","last_active":"2023-11-01T03:41:05.743990+0000","last_peered":"2023-11-01T03:41:05.743990+0000","last_clean":"2023-11-01T03:41:05.743990+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:05.743990+0000","last_undegraded":"2023-11-01T03:41:05.743990+0000","last_fullsized":"2023-11-01T03:41:05.743990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:57:06.365710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":866,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.720040+0000","last_change":"2023-11-01T03:20:25.561602+0000","last_active":"2023-11-01T03:41:05.720040+0000","last_peered":"2023-11-01T03:41:05.720040+0000","last_clean":"2023-11-01T03:41:05.720040+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:05.720040+0000","last_undegraded":"2023-11-01T03:41:05.720040+0000","last_fullsized":"2023-11-01T03:41:05.720040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:09:15.818152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":863,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.754582+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:41:05.754582+0000","last_peered":"2023-11-01T03:41:05.754582+0000","last_clean":"2023-11-01T03:41:05.754582+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:05.754582+0000","last_undegraded":"2023-11-01T03:41:05.754582+0000","last_fullsized":"2023-11-01T03:41:05.754582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:58:42.434193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"902'78","reported_seq":976,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:12.949854+0000","last_change":"2023-11-01T03:41:12.955879+0000","last_active":"2023-11-01T03:41:12.949854+0000","last_peered":"2023-11-01T03:41:12.949854+0000","last_clean":"2023-11-01T03:41:12.949854+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:12.949854+0000","last_undegraded":"2023-11-01T03:41:12.949854+0000","last_fullsized":"2023-11-01T03:41:12.949854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"902'78","last_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_deep_scrub":"902'78","last_deep_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_clean_scrub_stamp":"2023-11-01T03:41:12.948002+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:01:43.692010+0000","scrub_duration":0.15311366100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":870,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.558992+0000","last_change":"2023-11-01T03:20:23.770784+0000","last_active":"2023-11-01T03:41:05.558992+0000","last_peered":"2023-11-01T03:41:05.558992+0000","last_clean":"2023-11-01T03:41:05.558992+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:05.558992+0000","last_undegraded":"2023-11-01T03:41:05.558992+0000","last_fullsized":"2023-11-01T03:41:05.558992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:52:35.620928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":856,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:08.882427+0000","last_change":"2023-11-01T03:20:16.655844+0000","last_active":"2023-11-01T03:41:08.882427+0000","last_peered":"2023-11-01T03:41:08.882427+0000","last_clean":"2023-11-01T03:41:08.882427+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:08.882427+0000","last_undegraded":"2023-11-01T03:41:08.882427+0000","last_fullsized":"2023-11-01T03:41:08.882427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":867,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.723013+0000","last_change":"2023-11-01T03:20:27.628859+0000","last_active":"2023-11-01T03:41:05.723013+0000","last_peered":"2023-11-01T03:41:05.723013+0000","last_clean":"2023-11-01T03:41:05.723013+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:05.723013+0000","last_undegraded":"2023-11-01T03:41:05.723013+0000","last_fullsized":"2023-11-01T03:41:05.723013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T03:50:18.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"39'7","reported_seq":868,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.742829+0000","last_change":"2023-11-01T03:20:16.772503+0000","last_active":"2023-11-01T03:41:05.742829+0000","last_peered":"2023-11-01T03:41:05.742829+0000","last_clean":"2023-11-01T03:41:05.742829+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:05.742829+0000","last_undegraded":"2023-11-01T03:41:05.742829+0000","last_fullsized":"2023-11-01T03:41:05.742829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T08:41:51.271420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":856,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.489042+0000","last_change":"2023-11-01T03:20:20.690944+0000","last_active":"2023-11-01T03:41:06.489042+0000","last_peered":"2023-11-01T03:41:06.489042+0000","last_clean":"2023-11-01T03:41:06.489042+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:06.489042+0000","last_undegraded":"2023-11-01T03:41:06.489042+0000","last_fullsized":"2023-11-01T03:41:06.489042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":854,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.498449+0000","last_change":"2023-11-01T03:20:31.376540+0000","last_active":"2023-11-01T03:41:06.498449+0000","last_peered":"2023-11-01T03:41:06.498449+0000","last_clean":"2023-11-01T03:41:06.498449+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:06.498449+0000","last_undegraded":"2023-11-01T03:41:06.498449+0000","last_fullsized":"2023-11-01T03:41:06.498449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":855,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.500783+0000","last_change":"2023-11-01T03:20:15.800818+0000","last_active":"2023-11-01T03:41:06.500783+0000","last_peered":"2023-11-01T03:41:06.500783+0000","last_clean":"2023-11-01T03:41:06.500783+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:06.500783+0000","last_undegraded":"2023-11-01T03:41:06.500783+0000","last_fullsized":"2023-11-01T03:41:06.500783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:20:00.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.430257+0000","last_change":"2023-11-01T03:20:38.737137+0000","last_active":"2023-11-01T03:41:06.430257+0000","last_peered":"2023-11-01T03:41:06.430257+0000","last_clean":"2023-11-01T03:41:06.430257+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:06.430257+0000","last_undegraded":"2023-11-01T03:41:06.430257+0000","last_fullsized":"2023-11-01T03:41:06.430257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:57:06.339181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":865,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.699853+0000","last_change":"2023-11-01T03:20:21.863000+0000","last_active":"2023-11-01T03:41:05.699853+0000","last_peered":"2023-11-01T03:41:05.699853+0000","last_clean":"2023-11-01T03:41:05.699853+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:05.699853+0000","last_undegraded":"2023-11-01T03:41:05.699853+0000","last_fullsized":"2023-11-01T03:41:05.699853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:08:06.676287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":854,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.486681+0000","last_change":"2023-11-01T03:20:21.943627+0000","last_active":"2023-11-01T03:41:06.486681+0000","last_peered":"2023-11-01T03:41:06.486681+0000","last_clean":"2023-11-01T03:41:06.486681+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:06.486681+0000","last_undegraded":"2023-11-01T03:41:06.486681+0000","last_fullsized":"2023-11-01T03:41:06.486681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":855,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.478093+0000","last_change":"2023-11-01T03:20:31.359278+0000","last_active":"2023-11-01T03:41:06.478093+0000","last_peered":"2023-11-01T03:41:06.478093+0000","last_clean":"2023-11-01T03:41:06.478093+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:06.478093+0000","last_undegraded":"2023-11-01T03:41:06.478093+0000","last_fullsized":"2023-11-01T03:41:06.478093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":868,"reported_epoch":901,"state":"active+clean","last_fresh":"2023-11-01T03:41:05.560602+0000","last_change":"2023-11-01T03:20:20.196742+0000","last_active":"2023-11-01T03:41:05.560602+0000","last_peered":"2023-11-01T03:41:05.560602+0000","last_clean":"2023-11-01T03:41:05.560602+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:05.560602+0000","last_undegraded":"2023-11-01T03:41:05.560602+0000","last_fullsized":"2023-11-01T03:41:05.560602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T09:20:43.175812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444299,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58676,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313164,"statfs":{"total":96636764160,"available":96576679936,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":12.141999999999999},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":13.766999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":11.226000000000001},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":8.5370000000000008}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":16.253},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":10.557}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":8.0860000000000003},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":15.036}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":17.276},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":12.962}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":19.725999999999999},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":21.335000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":20.670000000000002},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":18.247}]}]},{"osd":1,"up_from":16,"seq":68719477004,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81264,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290576,"statfs":{"total":96636764160,"available":96553549824,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":26.581,"5min":15.032,"15min":17.754000000000001},"min":{"1min":6.7830000000000004,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":202.77600000000001,"5min":202.77600000000001,"15min":233.18799999999999},"last":8.3330000000000002},{"interface":"front","average":{"1min":25.585000000000001,"5min":17.437000000000001,"15min":20.001000000000001},"min":{"1min":8.0950000000000006,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":211.577,"5min":211.577,"15min":227.72900000000001},"last":10.382}]},{"osd":2,"last update":"Wed Nov 1 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":15.635,"5min":19.303000000000001,"15min":23.484999999999999},"min":{"1min":7.8239999999999998,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":62.979999999999997,"5min":157.964,"15min":226.35300000000001},"last":8.9559999999999995},{"interface":"front","average":{"1min":16.472000000000001,"5min":21.312000000000001,"15min":22.969000000000001},"min":{"1min":8.7490000000000006,"5min":7.649,"15min":6.7699999999999996},"max":{"1min":44.670999999999999,"5min":230.01499999999999,"15min":230.01499999999999},"last":12.023}]},{"osd":3,"last update":"Wed Nov 1 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":22.356000000000002,"5min":19.739999999999998,"15min":26.463000000000001},"min":{"1min":9.2609999999999992,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":139.18199999999999,"5min":139.18199999999999,"15min":301.214},"last":15.545999999999999},{"interface":"front","average":{"1min":20.103999999999999,"5min":16.913,"15min":23.349},"min":{"1min":7.2690000000000001,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":158.572,"5min":167.44900000000001,"15min":289.25400000000002},"last":7.1159999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":25.346,"5min":19.154,"15min":21.763999999999999},"min":{"1min":6.8310000000000004,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":92.372,"5min":92.372,"15min":228.119},"last":12.663},{"interface":"front","average":{"1min":21.606000000000002,"5min":17.113,"15min":22.614999999999998},"min":{"1min":6.8810000000000002,"5min":6.7969999999999997,"15min":6.7969999999999997},"max":{"1min":82.914000000000001,"5min":82.914000000000001,"15min":265.774},"last":9.7050000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":20.431999999999999,"5min":21.949999999999999,"15min":26.109999999999999},"min":{"1min":7.234,"5min":7.234,"15min":7.234},"max":{"1min":47.537999999999997,"5min":104.411,"15min":277.53100000000001},"last":18.504999999999999},{"interface":"front","average":{"1min":18.678999999999998,"5min":21.218,"15min":25.378},"min":{"1min":7.9809999999999999,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":86.488,"5min":107.372,"15min":270.26400000000001},"last":19.501000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.664999999999999,"5min":22.835999999999999,"15min":26.817},"min":{"1min":10.542999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":55.893000000000001,"5min":111.179,"15min":240.887},"last":14.709},{"interface":"front","average":{"1min":22.527999999999999,"5min":26.219999999999999,"15min":29.495999999999999},"min":{"1min":14.475,"5min":13.331,"15min":10.785},"max":{"1min":59.003999999999998,"5min":144.75399999999999,"15min":271.04899999999998},"last":16.617999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.878,"5min":17.433,"15min":26.861000000000001},"min":{"1min":9.0549999999999997,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":88.796000000000006,"5min":88.796000000000006,"15min":348.608},"last":13.44},{"interface":"front","average":{"1min":24.318999999999999,"5min":24.468,"15min":31.408000000000001},"min":{"1min":15.694000000000001,"5min":12.734999999999999,"15min":11.98},"max":{"1min":89.978999999999999,"5min":104.134,"15min":345.22899999999998},"last":17.468}]}]},{"osd":3,"up_from":16,"seq":68719477003,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76720,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295120,"statfs":{"total":96636764160,"available":96558202880,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":9.0429999999999993},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":11.651999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":10.996},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":18.734999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":17.233000000000001},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":10.366}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":13.106999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":14.417999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":17.989999999999998},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":19.931000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":13.728},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":15.050000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":15.672000000000001},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":20.751000000000001}]}]},{"osd":0,"up_from":16,"seq":68719477004,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62832,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309008,"statfs":{"total":96636764160,"available":96572424192,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":15.183,"5min":13.965999999999999,"15min":20.741},"min":{"1min":8.4350000000000005,"5min":6.2430000000000003,"15min":5.0919999999999996},"max":{"1min":29.344000000000001,"5min":63.280000000000001,"15min":193.87200000000001},"last":9.0600000000000005},{"interface":"front","average":{"1min":13.127000000000001,"5min":13.782,"15min":19.478999999999999},"min":{"1min":6.4610000000000003,"5min":6.0229999999999997,"15min":6.0179999999999998},"max":{"1min":41.377000000000002,"5min":61.674999999999997,"15min":208.66800000000001},"last":12.887}]},{"osd":2,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.792000000000002,"5min":17.826000000000001,"15min":24.395},"min":{"1min":9.9939999999999998,"5min":8.1379999999999999,"15min":6.657},"max":{"1min":31.626000000000001,"5min":93.488,"15min":238.64400000000001},"last":7.4580000000000002},{"interface":"front","average":{"1min":16.863,"5min":16.988,"15min":21.623000000000001},"min":{"1min":7.1680000000000001,"5min":6.8760000000000003,"15min":6.2300000000000004},"max":{"1min":50.618000000000002,"5min":102.666,"15min":272.35500000000002},"last":11.167999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:40:51 2023","interfaces":[{"interface":"back","average":{"1min":16.027999999999999,"5min":15.141999999999999,"15min":25.698},"min":{"1min":7.6429999999999998,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":67.299999999999997,"5min":67.299999999999997,"15min":285.99099999999999},"last":13.673999999999999},{"interface":"front","average":{"1min":22.164000000000001,"5min":21.707000000000001,"15min":27.375},"min":{"1min":10.720000000000001,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":66.314999999999998,"5min":216.52000000000001,"15min":334.51100000000002},"last":15.474}]},{"osd":4,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.289999999999999,"5min":20.956,"15min":24.43},"min":{"1min":11.702,"5min":7.5789999999999997,"15min":7.5789999999999997},"max":{"1min":38.886000000000003,"5min":206.935,"15min":206.935},"last":8.3219999999999992},{"interface":"front","average":{"1min":18.594999999999999,"5min":18.873999999999999,"15min":25.129999999999999},"min":{"1min":11.151,"5min":6.867,"15min":6.867},"max":{"1min":51.771999999999998,"5min":143.786,"15min":259.03399999999999},"last":11.824999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.010999999999999,"5min":21.155000000000001,"15min":22.881},"min":{"1min":6.7779999999999996,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.651000000000003,"5min":178.88300000000001,"15min":225.07300000000001},"last":16.125},{"interface":"front","average":{"1min":22.504000000000001,"5min":25.228999999999999,"15min":26.687999999999999},"min":{"1min":13.220000000000001,"5min":11.926,"15min":8.423},"max":{"1min":50.25,"5min":178.24199999999999,"15min":198.66900000000001},"last":18.251999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":20.844000000000001,"15min":28.954999999999998},"min":{"1min":9.218,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":53.276000000000003,"5min":177.26900000000001,"15min":450.18599999999998},"last":9.7680000000000007},{"interface":"front","average":{"1min":24.831,"5min":24.460000000000001,"15min":31.073},"min":{"1min":15.340999999999999,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":51.051000000000002,"5min":91.165999999999997,"15min":282.93000000000001},"last":17.463000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":22.015000000000001,"5min":23.861999999999998,"15min":27.366},"min":{"1min":9.5079999999999991,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":52.453000000000003,"5min":144.767,"15min":230.99600000000001},"last":20.623999999999999},{"interface":"front","average":{"1min":24.102,"5min":25.707999999999998,"15min":30.646000000000001},"min":{"1min":10.026999999999999,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":45.552,"5min":148.28200000000001,"15min":226.959},"last":14.832000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509709,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77112,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294728,"statfs":{"total":96636764160,"available":96557801472,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":10.679,"5min":14.500999999999999,"15min":18.439},"min":{"1min":4.9640000000000004,"5min":4.444,"15min":4.444},"max":{"1min":20.597999999999999,"5min":70.945999999999998,"15min":231.386},"last":9.8919999999999995},{"interface":"front","average":{"1min":10.138,"5min":16.434999999999999,"15min":21.382999999999999},"min":{"1min":5.0300000000000002,"5min":4.5090000000000003,"15min":4.5090000000000003},"max":{"1min":18.754999999999999,"5min":111.236,"15min":229.50299999999999},"last":5.5830000000000002}]},{"osd":1,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.744999999999999,"5min":20.986999999999998,"15min":23.802},"min":{"1min":6.3540000000000001,"5min":6.0179999999999998,"15min":5.3780000000000001},"max":{"1min":58.527999999999999,"5min":302.94099999999997,"15min":328.08199999999999},"last":7.2560000000000002},{"interface":"front","average":{"1min":18.532,"5min":27.169,"15min":31.489000000000001},"min":{"1min":8.2050000000000001,"5min":7.6340000000000003,"15min":7.6340000000000003},"max":{"1min":60.542999999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":14.305}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":15.901,"5min":22.568000000000001,"15min":23.664999999999999},"min":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":34.584000000000003,"5min":195.53700000000001,"15min":195.53700000000001},"last":11.596},{"interface":"front","average":{"1min":13.531000000000001,"5min":22.632000000000001,"15min":22.719000000000001},"min":{"1min":6.4530000000000003,"5min":6.4109999999999996,"15min":6.0259999999999998},"max":{"1min":20.637,"5min":252.57900000000001,"15min":252.57900000000001},"last":12.122}]},{"osd":3,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":15.587,"5min":25.533000000000001,"15min":30.013000000000002},"min":{"1min":9.452,"5min":6.383,"15min":6.383},"max":{"1min":22.768000000000001,"5min":226.05600000000001,"15min":726.51099999999997},"last":17.216999999999999},{"interface":"front","average":{"1min":15.470000000000001,"5min":26.940000000000001,"15min":31.023},"min":{"1min":10.199,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":25.969999999999999,"5min":186.75999999999999,"15min":784.01700000000005},"last":13.573}]},{"osd":4,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.624000000000001,"5min":24.079999999999998,"15min":27.091999999999999},"min":{"1min":7.2830000000000004,"5min":7.2530000000000001,"15min":6.8979999999999997},"max":{"1min":28.57,"5min":158.505,"15min":327.47699999999998},"last":9.0869999999999997},{"interface":"front","average":{"1min":17.361999999999998,"5min":27.986999999999998,"15min":30.132000000000001},"min":{"1min":9.1989999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":29.838000000000001,"5min":205.315,"15min":315.95100000000002},"last":18.152000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":16.306999999999999,"5min":27.713999999999999,"15min":28.725000000000001},"min":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":29.844999999999999,"5min":171.857,"15min":249.559},"last":15.44},{"interface":"front","average":{"1min":14.456,"5min":27.353999999999999,"15min":31.786999999999999},"min":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":24.298999999999999,"5min":182.077,"15min":383.42099999999999},"last":12.728}]},{"osd":7,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":17.582000000000001,"5min":25.562000000000001,"15min":28.114999999999998},"min":{"1min":11.412000000000001,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":32.265999999999998,"5min":170.60599999999999,"15min":215.22399999999999},"last":16.068999999999999},{"interface":"front","average":{"1min":17.917000000000002,"5min":24.146000000000001,"15min":27.420000000000002},"min":{"1min":11.912000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":30.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":18.989000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542413,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58676,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313164,"statfs":{"total":96636764160,"available":96576679936,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":22.065000000000001,"5min":24.597999999999999,"15min":21.370999999999999},"min":{"1min":5.3769999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":132.393,"5min":205.869,"15min":205.869},"last":14.031000000000001},{"interface":"front","average":{"1min":23.149999999999999,"5min":28.571999999999999,"15min":25.462},"min":{"1min":10.762,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":146.113,"5min":248.73099999999999,"15min":248.73099999999999},"last":15.843}]},{"osd":1,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":12.084,"5min":21.053999999999998,"15min":23.530000000000001},"min":{"1min":6.6020000000000003,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":61.753,"5min":272.86900000000003,"15min":272.86900000000003},"last":6.431},{"interface":"front","average":{"1min":28.754999999999999,"5min":28.062000000000001,"15min":28.823},"min":{"1min":9.8300000000000001,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":267.911,"5min":267.911,"15min":352.642},"last":9.7319999999999993}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":17.931000000000001,"5min":24.111999999999998,"15min":24.303999999999998},"min":{"1min":8.8209999999999997,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":62.329000000000001,"5min":153.25399999999999,"15min":167.721},"last":13.111000000000001},{"interface":"front","average":{"1min":17.760999999999999,"5min":20.530999999999999,"15min":22.216000000000001},"min":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":71.908000000000001,"5min":156.71199999999999,"15min":317.15300000000002},"last":7.3390000000000004}]},{"osd":3,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":19.149999999999999,"5min":28.553999999999998,"15min":28.556000000000001},"min":{"1min":9.6020000000000003,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":66.546000000000006,"5min":207.48699999999999,"15min":864.23099999999999},"last":12.096},{"interface":"front","average":{"1min":25.015999999999998,"5min":25.204000000000001,"15min":21.548999999999999},"min":{"1min":6.2699999999999996,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":136.334,"5min":210.626,"15min":263.649},"last":8.5220000000000002}]},{"osd":4,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.088000000000001,"5min":27.611000000000001,"15min":24.763000000000002},"min":{"1min":11.535,"5min":7.6989999999999998,"15min":7.2000000000000002},"max":{"1min":89.551000000000002,"5min":159.137,"15min":168.39099999999999},"last":17.396999999999998},{"interface":"front","average":{"1min":16.887,"5min":23.902999999999999,"15min":21.550000000000001},"min":{"1min":9.5350000000000001,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":81.560000000000002,"5min":160.304,"15min":160.304},"last":10.552}]},{"osd":5,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.786999999999999,"5min":27.809999999999999,"15min":23.050000000000001},"min":{"1min":11.93,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":80.522999999999996,"5min":155.24299999999999,"15min":270.94600000000003},"last":16.629000000000001},{"interface":"front","average":{"1min":18.129000000000001,"5min":25.039000000000001,"15min":26.381},"min":{"1min":10.413,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":65.290999999999997,"5min":153.74199999999999,"15min":272.613},"last":14.935}]},{"osd":6,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":14.641999999999999,"5min":18.841000000000001,"15min":20.309000000000001},"min":{"1min":6.798,"5min":6.3719999999999999,"15min":5.9080000000000004},"max":{"1min":99.433000000000007,"5min":153.58699999999999,"15min":204.26400000000001},"last":11.377000000000001},{"interface":"front","average":{"1min":22.571999999999999,"5min":28.119,"15min":29.311},"min":{"1min":11.381,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":94.052999999999997,"5min":176.62899999999999,"15min":187.38900000000001},"last":18.178000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575118,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80880,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290960,"statfs":{"total":96636764160,"available":96553943040,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":14.619,"5min":18.068999999999999,"15min":17.006},"min":{"1min":4.7889999999999997,"5min":4.4829999999999997,"15min":4.431},"max":{"1min":74.355000000000004,"5min":182.16200000000001,"15min":215.01400000000001},"last":4.7649999999999997},{"interface":"front","average":{"1min":15.571999999999999,"5min":18.236999999999998,"15min":17.800999999999998},"min":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":70.613,"5min":165.08500000000001,"15min":208.00800000000001},"last":8.7650000000000006}]},{"osd":1,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":18.352,"5min":26.658000000000001,"15min":23.210000000000001},"min":{"1min":5.6749999999999998,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":120.19799999999999,"5min":508.113,"15min":508.113},"last":11},{"interface":"front","average":{"1min":14.755000000000001,"5min":21.356999999999999,"15min":19.134},"min":{"1min":6.5369999999999999,"5min":6.4210000000000003,"15min":5.1879999999999997},"max":{"1min":52.587000000000003,"5min":183.512,"15min":183.512},"last":7.8179999999999996}]},{"osd":2,"last update":"Wed Nov 1 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":23.193000000000001,"5min":26.809999999999999,"15min":22.952000000000002},"min":{"1min":7.0270000000000001,"5min":6.9059999999999997,"15min":6.3600000000000003},"max":{"1min":105.779,"5min":276.858,"15min":276.858},"last":9.3840000000000003},{"interface":"front","average":{"1min":32.453000000000003,"5min":31.931999999999999,"15min":24.888999999999999},"min":{"1min":7.9779999999999998,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":252.52099999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":11.640000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":20.033000000000001,"5min":21.949999999999999,"15min":26.713000000000001},"min":{"1min":8.0079999999999991,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":66.866,"5min":77.144000000000005,"15min":327.39800000000002},"last":16.082999999999998},{"interface":"front","average":{"1min":23.605,"5min":27.524000000000001,"15min":29.152000000000001},"min":{"1min":7.7480000000000002,"5min":7.2220000000000004,"15min":6.8659999999999997},"max":{"1min":95.472999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":14.327999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:34 2023","interfaces":[{"interface":"back","average":{"1min":17.314,"5min":19.512,"15min":19.417999999999999},"min":{"1min":8.7159999999999993,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":59.195999999999998,"5min":125.809,"15min":303.637},"last":10.409000000000001},{"interface":"front","average":{"1min":21.106000000000002,"5min":25.699000000000002,"15min":25.07},"min":{"1min":10.291,"5min":9.1750000000000007,"15min":7.4169999999999998},"max":{"1min":67.885999999999996,"5min":188.06700000000001,"15min":304.79700000000003},"last":12.478999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":19.776,"5min":25.221,"15min":22.968},"min":{"1min":9.952,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":68.028000000000006,"5min":125.69,"15min":143.779},"last":13.164},{"interface":"front","average":{"1min":21.169,"5min":32.682000000000002,"15min":27.797000000000001},"min":{"1min":10.411,"5min":9.5719999999999992,"15min":8.4670000000000005},"max":{"1min":71.522999999999996,"5min":530.04300000000001,"15min":530.04300000000001},"last":17.001999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":22.713999999999999,"5min":31.914999999999999,"15min":26.495000000000001},"min":{"1min":12.776,"5min":8.2309999999999999,"15min":7.4710000000000001},"max":{"1min":69.022000000000006,"5min":319.23700000000002,"15min":319.23700000000002},"last":13.769},{"interface":"front","average":{"1min":21.402000000000001,"5min":29.286000000000001,"15min":24.658000000000001},"min":{"1min":10.721,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":57.826999999999998,"5min":193.06299999999999,"15min":193.06299999999999},"last":17.856000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575118,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.542000000000002,"5min":14.725,"15min":17.497},"min":{"1min":4.8440000000000003,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":98.876000000000005,"5min":101.489,"15min":218.07300000000001},"last":18.850999999999999},{"interface":"front","average":{"1min":14.622999999999999,"5min":12.209,"15min":15.000999999999999},"min":{"1min":5.9889999999999999,"5min":5.3129999999999997,"15min":4.7670000000000003},"max":{"1min":111.852,"5min":111.852,"15min":180.934},"last":11.006}]},{"osd":1,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.305,"5min":17.294,"15min":20.532},"min":{"1min":6.9020000000000001,"5min":6.2030000000000003,"15min":5.7309999999999999},"max":{"1min":45.872999999999998,"5min":231.58799999999999,"15min":237.00800000000001},"last":6.5350000000000001},{"interface":"front","average":{"1min":14.226000000000001,"5min":16.335000000000001,"15min":23.113},"min":{"1min":6.8540000000000001,"5min":5.468,"15min":5.468},"max":{"1min":49.228999999999999,"5min":160.93700000000001,"15min":349.45100000000002},"last":10.07}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.260000000000002,"5min":19.155000000000001,"15min":23.353000000000002},"min":{"1min":8.327,"5min":6.9249999999999998,"15min":6.1890000000000001},"max":{"1min":41.594000000000001,"5min":189.38200000000001,"15min":317.30399999999997},"last":12.555},{"interface":"front","average":{"1min":16.364000000000001,"5min":21.843,"15min":22.341000000000001},"min":{"1min":8.532,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":51.375999999999998,"5min":260.46800000000002,"15min":260.46800000000002},"last":14.460000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":14.776,"5min":18.672000000000001,"15min":23.785},"min":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":54.658000000000001,"5min":165.47200000000001,"15min":421.14600000000002},"last":11.772},{"interface":"front","average":{"1min":19.300000000000001,"5min":19.853999999999999,"15min":26.306999999999999},"min":{"1min":8.3490000000000002,"5min":7.5960000000000001,"15min":7.1429999999999998},"max":{"1min":56.719999999999999,"5min":140.23099999999999,"15min":505.59199999999998},"last":7.4800000000000004}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":18.914000000000001,"5min":20.149000000000001,"15min":25.367999999999999},"min":{"1min":7.5830000000000002,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":104.053,"5min":137.20500000000001,"15min":326.33499999999998},"last":13.743},{"interface":"front","average":{"1min":22.571000000000002,"5min":21.366,"15min":26.219000000000001},"min":{"1min":10.512,"5min":9.2110000000000003,"15min":8.7469999999999999},"max":{"1min":113.79900000000001,"5min":133.33000000000001,"15min":272.53399999999999},"last":8.3030000000000008}]},{"osd":6,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":17.806000000000001,"5min":23.077000000000002,"15min":24.952999999999999},"min":{"1min":9.5030000000000001,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":47.222000000000001,"5min":350.44400000000002,"15min":483.47500000000002},"last":15.449},{"interface":"front","average":{"1min":20.527000000000001,"5min":27.356000000000002,"15min":31.510999999999999},"min":{"1min":9.9550000000000001,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":35.633000000000003,"5min":351.82100000000003,"15min":585.80600000000004},"last":16.943999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":16.501999999999999,"5min":19.431000000000001,"15min":24.059999999999999},"min":{"1min":10.826000000000001,"5min":7.399,"15min":7.399},"max":{"1min":36.344000000000001,"5min":138.69900000000001,"15min":240.44200000000001},"last":16.126999999999999},{"interface":"front","average":{"1min":22.460999999999999,"5min":22.478999999999999,"15min":27.318000000000001},"min":{"1min":13.057,"5min":9.907,"15min":8.1669999999999998},"max":{"1min":49.140999999999998,"5min":138.05699999999999,"15min":342.57799999999997},"last":18.068000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:17.905 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.906 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.906 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.906 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.907 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.907 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.907 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.907 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.908 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.908 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.908 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.909 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.909 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.909 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.909 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.910 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.910 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.910 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.911 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.911 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.911 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.911 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.912 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.912 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.912 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.912 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.913 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.913 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.913 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.913 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.914 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.914 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.914 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.915 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.915 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.915 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.915 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.916 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:17.916 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-01T03:41:22.948 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:24.257 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:22.952 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:24.261 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:22.966 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:24.276 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:22.996 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:24.268 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:23.000 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:24.272 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:23.000 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:24.310 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:23.003 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:24.313 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:23.016 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:24.288 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:23.023 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:24.333 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.089 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:29.399 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.091 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:29.401 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.106 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:29.416 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.137 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:29.409 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.138 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:29.410 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.143 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:29.453 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.145 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:29.455 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.149 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:29.420 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:28.155 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:29.465 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:37.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:38.016 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:39.326 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.021 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:39.331 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.028+0000 7f7c7f7a4640 10 monclient: get_monmap_and_config 2023-11-01T03:41:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.028+0000 7f7c7f7a4640 10 monclient: build_initial_monmap 2023-11-01T03:41:38.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.028+0000 7f7c7f7a4640 10 monclient: monmap: 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:38.029846+0000 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:38.029846+0000 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:38.032 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.029+0000 7f7c7f7a4640 1 Processor -- start 2023-11-01T03:41:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.029+0000 7f7c7f7a4640 1 -- start start 2023-11-01T03:41:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.029+0000 7f7c7f7a4640 10 monclient: init 2023-11-01T03:41:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2023-11-01T03:41:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7c780a8ae0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c7813f340 0x7f7c78145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-a con 0x7f7c7813f340 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ec0 0x7f7c78145540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-b con 0x7f7c780a8ec0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780a9600 con 0x7f7c780a8ae0 2023-11-01T03:41:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c780a9360 con 0x7f7c7813f340 2023-11-01T03:41:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780b80b0 con 0x7f7c780a8ec0 2023-11-01T03:41:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.030+0000 7f7c7f7a4640 10 monclient(hunting): authenticate will time out at 2774.254503s 2023-11-01T03:41:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.032+0000 7f7c7cd3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c7813f340 0x7f7c78145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c7813f340 0x7f7c78145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56966/0 (socket says 172.21.15.5:56966) 2023-11-01T03:41:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 1 -- 172.21.15.5:0/1744989230 learned_addr learned my addr 172.21.15.5:0/1744989230 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 10 monclient(hunting): get_auth_request con 0x7f7c7813f340 auth_method 0 2023-11-01T03:41:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.034+0000 7f7c7cd3f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.035+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:38.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.035+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.035+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.037+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_done global_id 15498 payload 274 2023-11-01T03:41:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.037+0000 7f7c7cd3f640 1 -- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ec0 msgr2=0x7f7c78145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.037+0000 7f7c7cd3f640 1 --2- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ec0 0x7f7c78145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.037+0000 7f7c7cd3f640 1 -- 172.21.15.5:0/1744989230 >> v1:172.21.15.153:6789/0 conn(0x7f7c780a8ae0 legacy=0x7f7c7813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.037+0000 7f7c7cd3f640 10 monclient: _finish_hunting 0 2023-11-01T03:41:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.038+0000 7f7c7cd3f640 1 monclient: found mon.noname-a 2023-11-01T03:41:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.038+0000 7f7c7cd3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.038+0000 7f7c7cd3f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.038+0000 7f7c7cd3f640 1 -- 172.21.15.5:0/1744989230 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78145a80 con 0x7f7c7813f340 2023-11-01T03:41:38.041 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:39.349 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.042+0000 7f7c7cd3f640 1 --2- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78145000 secure :-1 s=READY pgs=3011 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009870 tx=0x7f7c6802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51e039156839598 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 1 -- 172.21.15.5:0/1744989230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680317c0 con 0x7f7c7813f340 2023-11-01T03:41:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: dump: 2023-11-01T03:41:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:38.059 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:38.061 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: _finish_auth 0 2023-11-01T03:41:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:38.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 1 -- 172.21.15.5:0/1744989230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68031920 con 0x7f7c7813f340 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 5 monclient: authenticate success, global_id 15498 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 4 set_mon_vals no callback set 2023-11-01T03:41:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 1 -- 172.21.15.5:0/1744989230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68031cb0 con 0x7f7c7813f340 2023-11-01T03:41:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c6ffff640 10 monclient: dump: 2023-11-01T03:41:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:38.065 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.066 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:39.336 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 10 monclient: shutdown 2023-11-01T03:41:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 msgr2=0x7f7c78145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78145000 secure :-1 s=READY pgs=3011 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009870 tx=0x7f7c6802b860 comp rx=0 tx=0).stop 2023-11-01T03:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/1744989230 shutdown_connections 2023-11-01T03:41:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ec0 0x7f7c78145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/1744989230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78145000 unknown :-1 s=CLOSED pgs=3011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.058+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/1744989230 >> 172.21.15.5:0/1744989230 conn(0x7f7c780b7230 msgr2=0x7f7c780b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.059+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/1744989230 shutdown_connections 2023-11-01T03:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.059+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/1744989230 wait complete. 2023-11-01T03:41:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.059+0000 7f7c7f7a4640 10 monclient: build_initial_monmap 2023-11-01T03:41:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.059+0000 7f7c7f7a4640 10 monclient: monmap: 2023-11-01T03:41:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:38.072 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.059+0000 7f7c7f7a4640 1 librados: starting msgr at 2023-11-01T03:41:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 librados: starting objecter 2023-11-01T03:41:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 Processor -- start 2023-11-01T03:41:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 -- start start 2023-11-01T03:41:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 librados: setting wanted keys 2023-11-01T03:41:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 librados: calling monclient init 2023-11-01T03:41:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient: init 2023-11-01T03:41:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-01T03:41:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ae0 0x7f7c7813f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-c con 0x7f7c780a8ae0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 0x7f7c78143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-b con 0x7f7c780a8ec0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): picked mon.noname-a con 0x7f7c7813f340 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78138540 con 0x7f7c7813f340 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781415a0 con 0x7f7c780a8ec0 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78141260 con 0x7f7c780a8ae0 2023-11-01T03:41:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.060+0000 7f7c7f7a4640 10 monclient(hunting): authenticate will time out at 2774.284745s 2023-11-01T03:41:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.066+0000 7f7c7cd3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 0x7f7c78143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.066+0000 7f7c7dd41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 0x7f7c78143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:59566/0 (socket says 172.21.15.5:59566) 2023-11-01T03:41:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 1 -- 172.21.15.5:0/3827972141 learned_addr learned my addr 172.21.15.5:0/3827972141 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 10 monclient(hunting): get_auth_request con 0x7f7c780a8ec0 auth_method 0 2023-11-01T03:41:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.067+0000 7f7c7cd3f640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:38.079 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:39.339 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.069+0000 7f7c7dd41640 10 monclient(hunting): get_auth_request con 0x7f7c7813f340 auth_method 0 2023-11-01T03:41:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.069+0000 7f7c7dd41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.069+0000 7f7c7dd41640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.069+0000 7f7c7dd41640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:38.081 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:39.380 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.070+0000 7f7c7dd41640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.070+0000 7f7c7dd41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.070+0000 7f7c7dd41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.072+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.072+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.072+0000 7f7c7cd3f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.074+0000 7f7c7d540640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ae0 0x7f7c7813f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): get_auth_request con 0x7f7c780a8ae0 auth_method 0 2023-11-01T03:41:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:38.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:38.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.075+0000 7f7c7d540640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:38.085 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:39.386 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 10 monclient(hunting): handle_auth_done global_id 15501 payload 824 2023-11-01T03:41:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 -- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ae0 msgr2=0x7f7c7813f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ae0 0x7f7c7813f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 -- 172.21.15.5:0/3827972141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 msgr2=0x7f7c78143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 0x7f7c78143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 10 monclient: _finish_hunting 0 2023-11-01T03:41:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 monclient: found mon.noname-a 2023-11-01T03:41:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.076+0000 7f7c7dd41640 1 -- 172.21.15.5:0/3827972141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680094d0 con 0x7f7c7813f340 2023-11-01T03:41:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.082+0000 7f7c7dd41640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78140d20 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000bdf0 tx=0x7f7c7000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.082+0000 7f7c6dffb640 10 client.?.objecter ms_handle_connect 0x7f7c7813f340 2023-11-01T03:41:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.082+0000 7f7c6dffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:38.088 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:39.358 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.095 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:39.405 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ce70 con 0x7f7c7813f340 2023-11-01T03:41:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: dump: 2023-11-01T03:41:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:38.100 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: _finish_auth 0 2023-11-01T03:41:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: _check_auth_tickets 2023-11-01T03:41:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70014440 con 0x7f7c7813f340 2023-11-01T03:41:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 5 monclient: authenticate success, global_id 15501 2023-11-01T03:41:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 10 monclient: _renew_subs 2023-11-01T03:41:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781446c0 con 0x7f7c7813f340 2023-11-01T03:41:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014810 con 0x7f7c7813f340 2023-11-01T03:41:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6dffb640 10 monclient: dump: 2023-11-01T03:41:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:38.104 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c6f7fe640 4 set_mon_vals no callback set 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 10 client.15501.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 10 monclient: _renew_subs 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c78141ca0 con 0x7f7c7813f340 2023-11-01T03:41:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.096+0000 7f7c7f7a4640 1 librados: init done 2023-11-01T03:41:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.097+0000 7f7c7f7a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.097+0000 7f7c7f7a4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.097+0000 7f7c7f7a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.5:3300/0 2023-11-01T03:41:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.097+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7804e9f0 con 0x7f7c7813f340 2023-11-01T03:41:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.429+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c7001d3b0 con 0x7f7c7813f340 2023-11-01T03:41:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.429+0000 7f7c6dffb640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 0x7f7c5c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.430+0000 7f7c7d540640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 0x7f7c5c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.430+0000 7f7c7d540640 10 monclient: get_auth_request con 0x7f7c5c06c880 auth_method 0 2023-11-01T03:41:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.430+0000 7f7c6dffb640 10 client.15501.objecter ms_handle_connect 0x7f7c5c06c880 2023-11-01T03:41:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.430+0000 7f7c7d540640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 0x7f7c5c06ed40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098c0 tx=0x7f7c74009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f7c70058940 con 0x7f7c7813f340 2023-11-01T03:41:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 10 client.15501.objecter ms_dispatch 0x7f7c78000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 3 client.15501.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 3 client.15501.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 20 client.15501.objecter dump_active .. 0 homeless 2023-11-01T03:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c70054c80 con 0x7f7c7813f340 2023-11-01T03:41:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:38.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.445+0000 7f7c6dffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:38.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.636+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c780b1530 con 0x7f7c5c06c880 2023-11-01T03:41:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.643+0000 7f7c6dffb640 1 -- 172.21.15.5:0/3827972141 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151861 (secure 0 0 0) 0x7f7c780b1530 con 0x7f7c5c06c880 2023-11-01T03:41:38.645 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.645+0000 7f7c7f7a4640 10 librados: watch_flush enter 2023-11-01T03:41:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.645+0000 7f7c7f7a4640 10 librados: watch_flush exit 2023-11-01T03:41:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.645+0000 7f7c7f7a4640 20 client.15501.objecter shutdown clearing up homeless session... 2023-11-01T03:41:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.645+0000 7f7c7f7a4640 10 client.15501.objecter successfully canceled tick 2023-11-01T03:41:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 msgr2=0x7f7c5c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 0x7f7c5c06ed40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098c0 tx=0x7f7c74009060 comp rx=0 tx=0).stop 2023-11-01T03:41:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 10 monclient: shutdown 2023-11-01T03:41:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 msgr2=0x7f7c78140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78140d20 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000bdf0 tx=0x7f7c7000bee0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 shutdown_connections 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f7c5c06c880 0x7f7c5c06ed40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c7813f340 0x7f7c78140d20 unknown :-1 s=CLOSED pgs=3012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c780a8ec0 0x7f7c78143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 --2- 172.21.15.5:0/3827972141 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f7c780a8ae0 0x7f7c7813f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 >> 172.21.15.5:0/3827972141 conn(0x7f7c780b7230 msgr2=0x7f7c78136ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 shutdown_connections 2023-11-01T03:41:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 -- 172.21.15.5:0/3827972141 wait complete. 2023-11-01T03:41:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:38.646+0000 7f7c7f7a4640 1 librados: shutdown 2023-11-01T03:41:38.659 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1586,"stamp":"2023-11-01T03:41:37.515428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":554776,"kb_used_data":43032,"kb_used_omap":12,"kb_used_meta":511667,"kb_avail":754419944,"statfs":{"total":773094113280,"available":772526022656,"internally_reserved":0,"allocated":44064768,"data_stored":23660274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":523947577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002636"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":858,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.236619+0000","last_change":"2023-11-01T03:20:28.999446+0000","last_active":"2023-11-01T03:41:06.236619+0000","last_peered":"2023-11-01T03:41:06.236619+0000","last_clean":"2023-11-01T03:41:06.236619+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:06.236619+0000","last_undegraded":"2023-11-01T03:41:06.236619+0000","last_fullsized":"2023-11-01T03:41:06.236619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.551241+0000","last_change":"2023-11-01T03:20:21.292351+0000","last_active":"2023-11-01T03:41:15.551241+0000","last_peered":"2023-11-01T03:41:15.551241+0000","last_clean":"2023-11-01T03:41:15.551241+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:15.551241+0000","last_undegraded":"2023-11-01T03:41:15.551241+0000","last_fullsized":"2023-11-01T03:41:15.551241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":861,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.608665+0000","last_change":"2023-11-01T03:41:22.609839+0000","last_active":"2023-11-01T03:41:22.608665+0000","last_peered":"2023-11-01T03:41:22.608665+0000","last_clean":"2023-11-01T03:41:22.608665+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:22.608665+0000","last_undegraded":"2023-11-01T03:41:22.608665+0000","last_fullsized":"2023-11-01T03:41:22.608665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.607221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.607221+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.607221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:52:28.157328+0000","scrub_duration":0.067490516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.029175+0000","last_change":"2023-11-01T03:41:19.030306+0000","last_active":"2023-11-01T03:41:19.029175+0000","last_peered":"2023-11-01T03:41:19.029175+0000","last_clean":"2023-11-01T03:41:19.029175+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:19.029175+0000","last_undegraded":"2023-11-01T03:41:19.029175+0000","last_fullsized":"2023-11-01T03:41:19.029175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.027704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.027704+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.027704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:04:14.082213+0000","scrub_duration":0.062122528000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":859,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:12.649180+0000","last_change":"2023-11-01T03:20:14.753917+0000","last_active":"2023-11-01T03:41:12.649180+0000","last_peered":"2023-11-01T03:41:12.649180+0000","last_clean":"2023-11-01T03:41:12.649180+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:12.649180+0000","last_undegraded":"2023-11-01T03:41:12.649180+0000","last_fullsized":"2023-11-01T03:41:12.649180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.809357+0000","last_change":"2023-11-01T03:41:19.813683+0000","last_active":"2023-11-01T03:41:19.809357+0000","last_peered":"2023-11-01T03:41:19.809357+0000","last_clean":"2023-11-01T03:41:19.809357+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:19.809357+0000","last_undegraded":"2023-11-01T03:41:19.809357+0000","last_fullsized":"2023-11-01T03:41:19.809357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.807766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.807766+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.807766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:23:21.565914+0000","scrub_duration":0.050759169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:20.753735+0000","last_change":"2023-11-01T03:41:20.761325+0000","last_active":"2023-11-01T03:41:20.753735+0000","last_peered":"2023-11-01T03:41:20.753735+0000","last_clean":"2023-11-01T03:41:20.753735+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:20.753735+0000","last_undegraded":"2023-11-01T03:41:20.753735+0000","last_fullsized":"2023-11-01T03:41:20.753735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:20.747001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:20.747001+0000","last_clean_scrub_stamp":"2023-11-01T03:41:20.747001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:41:29.773625+0000","scrub_duration":0.227008341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.836598+0000","last_change":"2023-11-01T03:41:15.836598+0000","last_active":"2023-11-01T03:41:15.836598+0000","last_peered":"2023-11-01T03:41:15.836598+0000","last_clean":"2023-11-01T03:41:15.836598+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:15.836598+0000","last_undegraded":"2023-11-01T03:41:15.836598+0000","last_fullsized":"2023-11-01T03:41:15.836598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_clean_scrub_stamp":"2023-11-01T03:41:15.834047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:23:54.174101+0000","scrub_duration":0.045577138000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":877,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.243014+0000","last_change":"2023-11-01T03:41:22.244321+0000","last_active":"2023-11-01T03:41:22.243014+0000","last_peered":"2023-11-01T03:41:22.243014+0000","last_clean":"2023-11-01T03:41:22.243014+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:22.243014+0000","last_undegraded":"2023-11-01T03:41:22.243014+0000","last_fullsized":"2023-11-01T03:41:22.243014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.241591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.241591+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.241591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:12:56.650283+0000","scrub_duration":0.067804724999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":874,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.742199+0000","last_change":"2023-11-01T03:41:28.743288+0000","last_active":"2023-11-01T03:41:28.742199+0000","last_peered":"2023-11-01T03:41:28.742199+0000","last_clean":"2023-11-01T03:41:28.742199+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:28.742199+0000","last_undegraded":"2023-11-01T03:41:28.742199+0000","last_fullsized":"2023-11-01T03:41:28.742199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.740816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.740816+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.740816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:58:14.728298+0000","scrub_duration":0.026975186000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:30.260228+0000","last_change":"2023-11-01T03:41:30.261313+0000","last_active":"2023-11-01T03:41:30.260228+0000","last_peered":"2023-11-01T03:41:30.260228+0000","last_clean":"2023-11-01T03:41:30.260228+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:30.260228+0000","last_undegraded":"2023-11-01T03:41:30.260228+0000","last_fullsized":"2023-11-01T03:41:30.260228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:30.258819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:30.258819+0000","last_clean_scrub_stamp":"2023-11-01T03:41:30.258819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:33:40.216568+0000","scrub_duration":0.072408410000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.208808+0000","last_change":"2023-11-01T03:41:19.213004+0000","last_active":"2023-11-01T03:41:19.208808+0000","last_peered":"2023-11-01T03:41:19.208808+0000","last_clean":"2023-11-01T03:41:19.208808+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:19.208808+0000","last_undegraded":"2023-11-01T03:41:19.208808+0000","last_fullsized":"2023-11-01T03:41:19.208808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.207456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.207456+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.207456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:14:09.998506+0000","scrub_duration":0.051797727000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:27.214545+0000","last_change":"2023-11-01T03:41:27.215561+0000","last_active":"2023-11-01T03:41:27.214545+0000","last_peered":"2023-11-01T03:41:27.214545+0000","last_clean":"2023-11-01T03:41:27.214545+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:27.214545+0000","last_undegraded":"2023-11-01T03:41:27.214545+0000","last_fullsized":"2023-11-01T03:41:27.214545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:27.213220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:27.213220+0000","last_clean_scrub_stamp":"2023-11-01T03:41:27.213220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:19:36.334781+0000","scrub_duration":0.035011131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.392319+0000","last_change":"2023-11-01T03:41:28.396377+0000","last_active":"2023-11-01T03:41:28.392319+0000","last_peered":"2023-11-01T03:41:28.392319+0000","last_clean":"2023-11-01T03:41:28.392319+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:28.392319+0000","last_undegraded":"2023-11-01T03:41:28.392319+0000","last_fullsized":"2023-11-01T03:41:28.392319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.390830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.390830+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.390830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:47:34.121091+0000","scrub_duration":0.049869262999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":859,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.238296+0000","last_change":"2023-11-01T03:20:20.628315+0000","last_active":"2023-11-01T03:41:06.238296+0000","last_peered":"2023-11-01T03:41:06.238296+0000","last_clean":"2023-11-01T03:41:06.238296+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:06.238296+0000","last_undegraded":"2023-11-01T03:41:06.238296+0000","last_fullsized":"2023-11-01T03:41:06.238296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.064270+0000","last_change":"2023-11-01T03:41:18.065342+0000","last_active":"2023-11-01T03:41:18.064270+0000","last_peered":"2023-11-01T03:41:18.064270+0000","last_clean":"2023-11-01T03:41:18.064270+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:18.064270+0000","last_undegraded":"2023-11-01T03:41:18.064270+0000","last_fullsized":"2023-11-01T03:41:18.064270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.062849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.062849+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.062849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:25:54.581361+0000","scrub_duration":0.038207484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.536554+0000","last_change":"2023-11-01T03:41:26.537687+0000","last_active":"2023-11-01T03:41:26.536554+0000","last_peered":"2023-11-01T03:41:26.536554+0000","last_clean":"2023-11-01T03:41:26.536554+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:26.536554+0000","last_undegraded":"2023-11-01T03:41:26.536554+0000","last_fullsized":"2023-11-01T03:41:26.536554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.535072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.535072+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.535072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:07:11.883867+0000","scrub_duration":0.037739649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:27.335631+0000","last_change":"2023-11-01T03:41:27.336749+0000","last_active":"2023-11-01T03:41:27.335631+0000","last_peered":"2023-11-01T03:41:27.335631+0000","last_clean":"2023-11-01T03:41:27.335631+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:27.335631+0000","last_undegraded":"2023-11-01T03:41:27.335631+0000","last_fullsized":"2023-11-01T03:41:27.335631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:27.334219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:27.334219+0000","last_clean_scrub_stamp":"2023-11-01T03:41:27.334219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:26:51.046274+0000","scrub_duration":0.033472364999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.585127+0000","last_change":"2023-11-01T03:41:21.586810+0000","last_active":"2023-11-01T03:41:21.585127+0000","last_peered":"2023-11-01T03:41:21.585127+0000","last_clean":"2023-11-01T03:41:21.585127+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:21.585127+0000","last_undegraded":"2023-11-01T03:41:21.585127+0000","last_fullsized":"2023-11-01T03:41:21.585127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.581386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.581386+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.581386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:30:24.248816+0000","scrub_duration":0.084317545999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":880,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:16.795870+0000","last_change":"2023-11-01T03:41:16.797017+0000","last_active":"2023-11-01T03:41:16.795870+0000","last_peered":"2023-11-01T03:41:16.795870+0000","last_clean":"2023-11-01T03:41:16.795870+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:16.795870+0000","last_undegraded":"2023-11-01T03:41:16.795870+0000","last_fullsized":"2023-11-01T03:41:16.795870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:16.794332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:16.794332+0000","last_clean_scrub_stamp":"2023-11-01T03:41:16.794332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:55:12.831029+0000","scrub_duration":0.034160994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":875,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:20.793341+0000","last_change":"2023-11-01T03:41:20.794355+0000","last_active":"2023-11-01T03:41:20.793341+0000","last_peered":"2023-11-01T03:41:20.793341+0000","last_clean":"2023-11-01T03:41:20.793341+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:20.793341+0000","last_undegraded":"2023-11-01T03:41:20.793341+0000","last_fullsized":"2023-11-01T03:41:20.793341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:20.791954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:20.791954+0000","last_clean_scrub_stamp":"2023-11-01T03:41:20.791954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:15:29.287607+0000","scrub_duration":0.039221280999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.310702+0000","last_change":"2023-11-01T03:41:21.311839+0000","last_active":"2023-11-01T03:41:21.310702+0000","last_peered":"2023-11-01T03:41:21.310702+0000","last_clean":"2023-11-01T03:41:21.310702+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:21.310702+0000","last_undegraded":"2023-11-01T03:41:21.310702+0000","last_fullsized":"2023-11-01T03:41:21.310702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.309281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.309281+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.309281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:48:22.183527+0000","scrub_duration":0.032314994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:13.922300+0000","last_change":"2023-11-01T03:41:13.923450+0000","last_active":"2023-11-01T03:41:13.922300+0000","last_peered":"2023-11-01T03:41:13.922300+0000","last_clean":"2023-11-01T03:41:13.922300+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:13.922300+0000","last_undegraded":"2023-11-01T03:41:13.922300+0000","last_fullsized":"2023-11-01T03:41:13.922300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_clean_scrub_stamp":"2023-11-01T03:41:13.920800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:15:49.893573+0000","scrub_duration":0.074463761000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":868,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.131442+0000","last_change":"2023-11-01T03:41:21.132489+0000","last_active":"2023-11-01T03:41:21.131442+0000","last_peered":"2023-11-01T03:41:21.131442+0000","last_clean":"2023-11-01T03:41:21.131442+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:21.131442+0000","last_undegraded":"2023-11-01T03:41:21.131442+0000","last_fullsized":"2023-11-01T03:41:21.131442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.130059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.130059+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.130059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:38:54.898182+0000","scrub_duration":0.030713909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.435431+0000","last_change":"2023-11-01T03:20:27.836705+0000","last_active":"2023-11-01T03:41:06.435431+0000","last_peered":"2023-11-01T03:41:06.435431+0000","last_clean":"2023-11-01T03:41:06.435431+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:06.435431+0000","last_undegraded":"2023-11-01T03:41:06.435431+0000","last_fullsized":"2023-11-01T03:41:06.435431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":873,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.324911+0000","last_change":"2023-11-01T03:41:26.326053+0000","last_active":"2023-11-01T03:41:26.324911+0000","last_peered":"2023-11-01T03:41:26.324911+0000","last_clean":"2023-11-01T03:41:26.324911+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:26.324911+0000","last_undegraded":"2023-11-01T03:41:26.324911+0000","last_fullsized":"2023-11-01T03:41:26.324911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.323445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.323445+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.323445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:19:14.833218+0000","scrub_duration":0.043073855000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":875,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.768109+0000","last_change":"2023-11-01T03:41:18.769192+0000","last_active":"2023-11-01T03:41:18.768109+0000","last_peered":"2023-11-01T03:41:18.768109+0000","last_clean":"2023-11-01T03:41:18.768109+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:18.768109+0000","last_undegraded":"2023-11-01T03:41:18.768109+0000","last_fullsized":"2023-11-01T03:41:18.768109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.766658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.766658+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.766658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:42:44.290200+0000","scrub_duration":0.028759040999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.232408+0000","last_change":"2023-11-01T03:19:09.708546+0000","last_active":"2023-11-01T03:41:06.232408+0000","last_peered":"2023-11-01T03:41:06.232408+0000","last_clean":"2023-11-01T03:41:06.232408+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:06.232408+0000","last_undegraded":"2023-11-01T03:41:06.232408+0000","last_fullsized":"2023-11-01T03:41:06.232408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:19:07.461885+0000","last_clean_scrub_stamp":"2023-11-01T03:19:07.461885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"902'78","reported_seq":976,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:12.949854+0000","last_change":"2023-11-01T03:41:12.955879+0000","last_active":"2023-11-01T03:41:12.949854+0000","last_peered":"2023-11-01T03:41:12.949854+0000","last_clean":"2023-11-01T03:41:12.949854+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:12.949854+0000","last_undegraded":"2023-11-01T03:41:12.949854+0000","last_fullsized":"2023-11-01T03:41:12.949854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"902'78","last_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_deep_scrub":"902'78","last_deep_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_clean_scrub_stamp":"2023-11-01T03:41:12.948002+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:01:43.692010+0000","scrub_duration":0.15311366100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:25.191809+0000","last_change":"2023-11-01T03:41:25.192853+0000","last_active":"2023-11-01T03:41:25.191809+0000","last_peered":"2023-11-01T03:41:25.191809+0000","last_clean":"2023-11-01T03:41:25.191809+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:25.191809+0000","last_undegraded":"2023-11-01T03:41:25.191809+0000","last_fullsized":"2023-11-01T03:41:25.191809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:25.190412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:25.190412+0000","last_clean_scrub_stamp":"2023-11-01T03:41:25.190412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:37.179116+0000","scrub_duration":0.028020638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.010935+0000","last_change":"2023-11-01T03:41:15.013832+0000","last_active":"2023-11-01T03:41:15.010935+0000","last_peered":"2023-11-01T03:41:15.010935+0000","last_clean":"2023-11-01T03:41:15.010935+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:15.010935+0000","last_undegraded":"2023-11-01T03:41:15.010935+0000","last_fullsized":"2023-11-01T03:41:15.010935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:15.005965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:15.005965+0000","last_clean_scrub_stamp":"2023-11-01T03:41:15.005965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:05:57.909338+0000","scrub_duration":0.067646097000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":868,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:06.413317+0000","last_change":"2023-11-01T03:20:27.628859+0000","last_active":"2023-11-01T03:41:06.413317+0000","last_peered":"2023-11-01T03:41:06.413317+0000","last_clean":"2023-11-01T03:41:06.413317+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:06.413317+0000","last_undegraded":"2023-11-01T03:41:06.413317+0000","last_fullsized":"2023-11-01T03:41:06.413317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:20:08.921874+0000","last_clean_scrub_stamp":"2023-11-01T03:20:08.921874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"902'8","reported_seq":878,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:23.243704+0000","last_change":"2023-11-01T03:41:23.244943+0000","last_active":"2023-11-01T03:41:23.243704+0000","last_peered":"2023-11-01T03:41:23.243704+0000","last_clean":"2023-11-01T03:41:23.243704+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:23.243704+0000","last_undegraded":"2023-11-01T03:41:23.243704+0000","last_fullsized":"2023-11-01T03:41:23.243704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"902'8","last_scrub_stamp":"2023-11-01T03:41:23.242282+0000","last_deep_scrub":"902'8","last_deep_scrub_stamp":"2023-11-01T03:41:23.242282+0000","last_clean_scrub_stamp":"2023-11-01T03:41:23.242282+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:34:50.828622+0000","scrub_duration":0.080150692999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:23.545110+0000","last_change":"2023-11-01T03:41:23.548514+0000","last_active":"2023-11-01T03:41:23.545110+0000","last_peered":"2023-11-01T03:41:23.545110+0000","last_clean":"2023-11-01T03:41:23.545110+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:23.545110+0000","last_undegraded":"2023-11-01T03:41:23.545110+0000","last_fullsized":"2023-11-01T03:41:23.545110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:23.543658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:23.543658+0000","last_clean_scrub_stamp":"2023-11-01T03:41:23.543658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:00:04.199103+0000","scrub_duration":0.039640505999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:30.587126+0000","last_change":"2023-11-01T03:41:30.588259+0000","last_active":"2023-11-01T03:41:30.587126+0000","last_peered":"2023-11-01T03:41:30.587126+0000","last_clean":"2023-11-01T03:41:30.587126+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:30.587126+0000","last_undegraded":"2023-11-01T03:41:30.587126+0000","last_fullsized":"2023-11-01T03:41:30.587126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:30.585653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:30.585653+0000","last_clean_scrub_stamp":"2023-11-01T03:41:30.585653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:59:24.283570+0000","scrub_duration":0.063269760999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.211239+0000","last_change":"2023-11-01T03:41:26.212296+0000","last_active":"2023-11-01T03:41:26.211239+0000","last_peered":"2023-11-01T03:41:26.211239+0000","last_clean":"2023-11-01T03:41:26.211239+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:26.211239+0000","last_undegraded":"2023-11-01T03:41:26.211239+0000","last_fullsized":"2023-11-01T03:41:26.211239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.209830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.209830+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.209830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:27:59.206763+0000","scrub_duration":0.035157349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":876,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.787595+0000","last_change":"2023-11-01T03:41:22.788630+0000","last_active":"2023-11-01T03:41:22.787595+0000","last_peered":"2023-11-01T03:41:22.787595+0000","last_clean":"2023-11-01T03:41:22.787595+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:22.787595+0000","last_undegraded":"2023-11-01T03:41:22.787595+0000","last_fullsized":"2023-11-01T03:41:22.787595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.786190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.786190+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.786190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:17:44.340781+0000","scrub_duration":0.046937324000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":874,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.764092+0000","last_change":"2023-11-01T03:41:21.765146+0000","last_active":"2023-11-01T03:41:21.764092+0000","last_peered":"2023-11-01T03:41:21.764092+0000","last_clean":"2023-11-01T03:41:21.764092+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:21.764092+0000","last_undegraded":"2023-11-01T03:41:21.764092+0000","last_fullsized":"2023-11-01T03:41:21.764092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.762677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.762677+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.762677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:42:42.807809+0000","scrub_duration":0.033273957999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.088954+0000","last_change":"2023-11-01T03:41:19.090062+0000","last_active":"2023-11-01T03:41:19.088954+0000","last_peered":"2023-11-01T03:41:19.088954+0000","last_clean":"2023-11-01T03:41:19.088954+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:19.088954+0000","last_undegraded":"2023-11-01T03:41:19.088954+0000","last_fullsized":"2023-11-01T03:41:19.088954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.087591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.087591+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.087591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:13:48.007253+0000","scrub_duration":0.056343228000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.595970+0000","last_change":"2023-11-01T03:41:28.601458+0000","last_active":"2023-11-01T03:41:28.595970+0000","last_peered":"2023-11-01T03:41:28.595970+0000","last_clean":"2023-11-01T03:41:28.595970+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:28.595970+0000","last_undegraded":"2023-11-01T03:41:28.595970+0000","last_fullsized":"2023-11-01T03:41:28.595970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.594482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.594482+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.594482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:02:22.506742+0000","scrub_duration":0.036296297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":877,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.218105+0000","last_change":"2023-11-01T03:41:18.219153+0000","last_active":"2023-11-01T03:41:18.218105+0000","last_peered":"2023-11-01T03:41:18.218105+0000","last_clean":"2023-11-01T03:41:18.218105+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:18.218105+0000","last_undegraded":"2023-11-01T03:41:18.218105+0000","last_fullsized":"2023-11-01T03:41:18.218105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.216784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.216784+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.216784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:08:07.565854+0000","scrub_duration":0.050787885999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444303,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58664,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313176,"statfs":{"total":96636764160,"available":96576692224,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":10.929},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":9.0559999999999992}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":9.6820000000000004},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":17.419}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":14.638999999999999},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":7.9130000000000003}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":11.606999999999999},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":16.734999999999999}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":19.652999999999999},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":12.823}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":14.000999999999999},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":20.870999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":18.079000000000001},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":15.478999999999999}]}]},{"osd":1,"up_from":16,"seq":68719477008,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81264,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290576,"statfs":{"total":96636764160,"available":96553549824,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":26.581,"5min":15.032,"15min":17.754000000000001},"min":{"1min":6.7830000000000004,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":202.77600000000001,"5min":202.77600000000001,"15min":233.18799999999999},"last":8.5549999999999997},{"interface":"front","average":{"1min":25.585000000000001,"5min":17.437000000000001,"15min":20.001000000000001},"min":{"1min":8.0950000000000006,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":211.577,"5min":211.577,"15min":227.72900000000001},"last":13.739000000000001}]},{"osd":2,"last update":"Wed Nov 1 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":15.635,"5min":19.303000000000001,"15min":23.484999999999999},"min":{"1min":7.8239999999999998,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":62.979999999999997,"5min":157.964,"15min":226.35300000000001},"last":10.736000000000001},{"interface":"front","average":{"1min":16.472000000000001,"5min":21.312000000000001,"15min":22.969000000000001},"min":{"1min":8.7490000000000006,"5min":7.649,"15min":6.7699999999999996},"max":{"1min":44.670999999999999,"5min":230.01499999999999,"15min":230.01499999999999},"last":11.823}]},{"osd":3,"last update":"Wed Nov 1 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":22.356000000000002,"5min":19.739999999999998,"15min":26.463000000000001},"min":{"1min":9.2609999999999992,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":139.18199999999999,"5min":139.18199999999999,"15min":301.214},"last":12.462},{"interface":"front","average":{"1min":20.103999999999999,"5min":16.913,"15min":23.349},"min":{"1min":7.2690000000000001,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":158.572,"5min":167.44900000000001,"15min":289.25400000000002},"last":9.4499999999999993}]},{"osd":4,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":25.346,"5min":19.154,"15min":21.763999999999999},"min":{"1min":6.8310000000000004,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":92.372,"5min":92.372,"15min":228.119},"last":17.701000000000001},{"interface":"front","average":{"1min":21.606000000000002,"5min":17.113,"15min":22.614999999999998},"min":{"1min":6.8810000000000002,"5min":6.7969999999999997,"15min":6.7969999999999997},"max":{"1min":82.914000000000001,"5min":82.914000000000001,"15min":265.774},"last":16.105}]},{"osd":5,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":20.431999999999999,"5min":21.949999999999999,"15min":26.109999999999999},"min":{"1min":7.234,"5min":7.234,"15min":7.234},"max":{"1min":47.537999999999997,"5min":104.411,"15min":277.53100000000001},"last":19.654},{"interface":"front","average":{"1min":18.678999999999998,"5min":21.218,"15min":25.378},"min":{"1min":7.9809999999999999,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":86.488,"5min":107.372,"15min":270.26400000000001},"last":14.374000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.664999999999999,"5min":22.835999999999999,"15min":26.817},"min":{"1min":10.542999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":55.893000000000001,"5min":111.179,"15min":240.887},"last":13.127000000000001},{"interface":"front","average":{"1min":22.527999999999999,"5min":26.219999999999999,"15min":29.495999999999999},"min":{"1min":14.475,"5min":13.331,"15min":10.785},"max":{"1min":59.003999999999998,"5min":144.75399999999999,"15min":271.04899999999998},"last":20.667000000000002}]},{"osd":7,"last update":"Wed Nov 1 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":19.878,"5min":17.433,"15min":26.861000000000001},"min":{"1min":9.0549999999999997,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":88.796000000000006,"5min":88.796000000000006,"15min":348.608},"last":18.396000000000001},{"interface":"front","average":{"1min":24.318999999999999,"5min":24.468,"15min":31.408000000000001},"min":{"1min":15.694000000000001,"5min":12.734999999999999,"15min":11.98},"max":{"1min":89.978999999999999,"5min":104.134,"15min":345.22899999999998},"last":17.085000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477007,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76712,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295128,"statfs":{"total":96636764160,"available":96558211072,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":8.1349999999999998},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":7.1070000000000002}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":12.468},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":9.5449999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":15.339},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":8.9160000000000004}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":10.260999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":16.706}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":13.173999999999999},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":14.624000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":13.605},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":18.050999999999998}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":18.914999999999999},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":15.981999999999999}]}]},{"osd":0,"up_from":16,"seq":68719477008,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62824,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309016,"statfs":{"total":96636764160,"available":96572432384,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":15.183,"5min":13.965999999999999,"15min":20.741},"min":{"1min":8.4350000000000005,"5min":6.2430000000000003,"15min":5.0919999999999996},"max":{"1min":29.344000000000001,"5min":63.280000000000001,"15min":193.87200000000001},"last":6.3630000000000004},{"interface":"front","average":{"1min":13.127000000000001,"5min":13.782,"15min":19.478999999999999},"min":{"1min":6.4610000000000003,"5min":6.0229999999999997,"15min":6.0179999999999998},"max":{"1min":41.377000000000002,"5min":61.674999999999997,"15min":208.66800000000001},"last":9.8049999999999997}]},{"osd":2,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.792000000000002,"5min":17.826000000000001,"15min":24.395},"min":{"1min":9.9939999999999998,"5min":8.1379999999999999,"15min":6.657},"max":{"1min":31.626000000000001,"5min":93.488,"15min":238.64400000000001},"last":8.3989999999999991},{"interface":"front","average":{"1min":16.863,"5min":16.988,"15min":21.623000000000001},"min":{"1min":7.1680000000000001,"5min":6.8760000000000003,"15min":6.2300000000000004},"max":{"1min":50.618000000000002,"5min":102.666,"15min":272.35500000000002},"last":17.864000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:51 2023","interfaces":[{"interface":"back","average":{"1min":16.027999999999999,"5min":15.141999999999999,"15min":25.698},"min":{"1min":7.6429999999999998,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":67.299999999999997,"5min":67.299999999999997,"15min":285.99099999999999},"last":12.67},{"interface":"front","average":{"1min":22.164000000000001,"5min":21.707000000000001,"15min":27.375},"min":{"1min":10.720000000000001,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":66.314999999999998,"5min":216.52000000000001,"15min":334.51100000000002},"last":14.792999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.289999999999999,"5min":20.956,"15min":24.43},"min":{"1min":11.702,"5min":7.5789999999999997,"15min":7.5789999999999997},"max":{"1min":38.886000000000003,"5min":206.935,"15min":206.935},"last":9.016},{"interface":"front","average":{"1min":18.594999999999999,"5min":18.873999999999999,"15min":25.129999999999999},"min":{"1min":11.151,"5min":6.867,"15min":6.867},"max":{"1min":51.771999999999998,"5min":143.786,"15min":259.03399999999999},"last":18.702000000000002}]},{"osd":5,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":17.010999999999999,"5min":21.155000000000001,"15min":22.881},"min":{"1min":6.7779999999999996,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.651000000000003,"5min":178.88300000000001,"15min":225.07300000000001},"last":13.282999999999999},{"interface":"front","average":{"1min":22.504000000000001,"5min":25.228999999999999,"15min":26.687999999999999},"min":{"1min":13.220000000000001,"5min":11.926,"15min":8.423},"max":{"1min":50.25,"5min":178.24199999999999,"15min":198.66900000000001},"last":15.43}]},{"osd":6,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":20.844000000000001,"15min":28.954999999999998},"min":{"1min":9.218,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":53.276000000000003,"5min":177.26900000000001,"15min":450.18599999999998},"last":10.48},{"interface":"front","average":{"1min":24.831,"5min":24.460000000000001,"15min":31.073},"min":{"1min":15.340999999999999,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":51.051000000000002,"5min":91.165999999999997,"15min":282.93000000000001},"last":14.006}]},{"osd":7,"last update":"Wed Nov 1 03:40:50 2023","interfaces":[{"interface":"back","average":{"1min":22.015000000000001,"5min":23.861999999999998,"15min":27.366},"min":{"1min":9.5079999999999991,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":52.453000000000003,"5min":144.767,"15min":230.99600000000001},"last":11.185},{"interface":"front","average":{"1min":24.102,"5min":25.707999999999998,"15min":30.646000000000001},"min":{"1min":10.026999999999999,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":45.552,"5min":148.28200000000001,"15min":226.959},"last":16.053000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509713,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77104,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294736,"statfs":{"total":96636764160,"available":96557809664,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":10.679,"5min":14.500999999999999,"15min":18.439},"min":{"1min":4.9640000000000004,"5min":4.444,"15min":4.444},"max":{"1min":20.597999999999999,"5min":70.945999999999998,"15min":231.386},"last":4.9119999999999999},{"interface":"front","average":{"1min":10.138,"5min":16.434999999999999,"15min":21.382999999999999},"min":{"1min":5.0300000000000002,"5min":4.5090000000000003,"15min":4.5090000000000003},"max":{"1min":18.754999999999999,"5min":111.236,"15min":229.50299999999999},"last":8.0820000000000007}]},{"osd":1,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.744999999999999,"5min":20.986999999999998,"15min":23.802},"min":{"1min":6.3540000000000001,"5min":6.0179999999999998,"15min":5.3780000000000001},"max":{"1min":58.527999999999999,"5min":302.94099999999997,"15min":328.08199999999999},"last":9.0329999999999995},{"interface":"front","average":{"1min":18.532,"5min":27.169,"15min":31.489000000000001},"min":{"1min":8.2050000000000001,"5min":7.6340000000000003,"15min":7.6340000000000003},"max":{"1min":60.542999999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":10.057}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":15.901,"5min":22.568000000000001,"15min":23.664999999999999},"min":{"1min":6.2510000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":34.584000000000003,"5min":195.53700000000001,"15min":195.53700000000001},"last":13.554},{"interface":"front","average":{"1min":13.531000000000001,"5min":22.632000000000001,"15min":22.719000000000001},"min":{"1min":6.4530000000000003,"5min":6.4109999999999996,"15min":6.0259999999999998},"max":{"1min":20.637,"5min":252.57900000000001,"15min":252.57900000000001},"last":14.754}]},{"osd":3,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":15.587,"5min":25.533000000000001,"15min":30.013000000000002},"min":{"1min":9.452,"5min":6.383,"15min":6.383},"max":{"1min":22.768000000000001,"5min":226.05600000000001,"15min":726.51099999999997},"last":16.756},{"interface":"front","average":{"1min":15.470000000000001,"5min":26.940000000000001,"15min":31.023},"min":{"1min":10.199,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":25.969999999999999,"5min":186.75999999999999,"15min":784.01700000000005},"last":14.127000000000001}]},{"osd":4,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":14.624000000000001,"5min":24.079999999999998,"15min":27.091999999999999},"min":{"1min":7.2830000000000004,"5min":7.2530000000000001,"15min":6.8979999999999997},"max":{"1min":28.57,"5min":158.505,"15min":327.47699999999998},"last":11.497999999999999},{"interface":"front","average":{"1min":17.361999999999998,"5min":27.986999999999998,"15min":30.132000000000001},"min":{"1min":9.1989999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":29.838000000000001,"5min":205.315,"15min":315.95100000000002},"last":18.370000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":16.306999999999999,"5min":27.713999999999999,"15min":28.725000000000001},"min":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":29.844999999999999,"5min":171.857,"15min":249.559},"last":15.414999999999999},{"interface":"front","average":{"1min":14.456,"5min":27.353999999999999,"15min":31.786999999999999},"min":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":24.298999999999999,"5min":182.077,"15min":383.42099999999999},"last":12.394}]},{"osd":7,"last update":"Wed Nov 1 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":17.582000000000001,"5min":25.562000000000001,"15min":28.114999999999998},"min":{"1min":11.412000000000001,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":32.265999999999998,"5min":170.60599999999999,"15min":215.22399999999999},"last":16.059000000000001},{"interface":"front","average":{"1min":17.917000000000002,"5min":24.146000000000001,"15min":27.420000000000002},"min":{"1min":11.912000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":30.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":19.126000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542417,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":22.065000000000001,"5min":24.597999999999999,"15min":21.370999999999999},"min":{"1min":5.3769999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":132.393,"5min":205.869,"15min":205.869},"last":11.243},{"interface":"front","average":{"1min":23.149999999999999,"5min":28.571999999999999,"15min":25.462},"min":{"1min":10.762,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":146.113,"5min":248.73099999999999,"15min":248.73099999999999},"last":11.946}]},{"osd":1,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":12.084,"5min":21.053999999999998,"15min":23.530000000000001},"min":{"1min":6.6020000000000003,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":61.753,"5min":272.86900000000003,"15min":272.86900000000003},"last":8.3919999999999995},{"interface":"front","average":{"1min":28.754999999999999,"5min":28.062000000000001,"15min":28.823},"min":{"1min":9.8300000000000001,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":267.911,"5min":267.911,"15min":352.642},"last":12.627000000000001}]},{"osd":2,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":17.931000000000001,"5min":24.111999999999998,"15min":24.303999999999998},"min":{"1min":8.8209999999999997,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":62.329000000000001,"5min":153.25399999999999,"15min":167.721},"last":13.289999999999999},{"interface":"front","average":{"1min":17.760999999999999,"5min":20.530999999999999,"15min":22.216000000000001},"min":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":71.908000000000001,"5min":156.71199999999999,"15min":317.15300000000002},"last":10.601000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":19.149999999999999,"5min":28.553999999999998,"15min":28.556000000000001},"min":{"1min":9.6020000000000003,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":66.546000000000006,"5min":207.48699999999999,"15min":864.23099999999999},"last":18.058},{"interface":"front","average":{"1min":25.015999999999998,"5min":25.204000000000001,"15min":21.548999999999999},"min":{"1min":6.2699999999999996,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":136.334,"5min":210.626,"15min":263.649},"last":7.0759999999999996}]},{"osd":4,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.088000000000001,"5min":27.611000000000001,"15min":24.763000000000002},"min":{"1min":11.535,"5min":7.6989999999999998,"15min":7.2000000000000002},"max":{"1min":89.551000000000002,"5min":159.137,"15min":168.39099999999999},"last":14.627000000000001},{"interface":"front","average":{"1min":16.887,"5min":23.902999999999999,"15min":21.550000000000001},"min":{"1min":9.5350000000000001,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":81.560000000000002,"5min":160.304,"15min":160.304},"last":15.954000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":21.786999999999999,"5min":27.809999999999999,"15min":23.050000000000001},"min":{"1min":11.93,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":80.522999999999996,"5min":155.24299999999999,"15min":270.94600000000003},"last":15.215},{"interface":"front","average":{"1min":18.129000000000001,"5min":25.039000000000001,"15min":26.381},"min":{"1min":10.413,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":65.290999999999997,"5min":153.74199999999999,"15min":272.613},"last":18.937999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":14.641999999999999,"5min":18.841000000000001,"15min":20.309000000000001},"min":{"1min":6.798,"5min":6.3719999999999999,"15min":5.9080000000000004},"max":{"1min":99.433000000000007,"5min":153.58699999999999,"15min":204.26400000000001},"last":9.1519999999999992},{"interface":"front","average":{"1min":22.571999999999999,"5min":28.119,"15min":29.311},"min":{"1min":11.381,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":94.052999999999997,"5min":176.62899999999999,"15min":187.38900000000001},"last":13.978999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575122,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80872,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290968,"statfs":{"total":96636764160,"available":96553951232,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":14.619,"5min":18.068999999999999,"15min":17.006},"min":{"1min":4.7889999999999997,"5min":4.4829999999999997,"15min":4.431},"max":{"1min":74.355000000000004,"5min":182.16200000000001,"15min":215.01400000000001},"last":18.141999999999999},{"interface":"front","average":{"1min":15.571999999999999,"5min":18.236999999999998,"15min":17.800999999999998},"min":{"1min":4.2370000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":70.613,"5min":165.08500000000001,"15min":208.00800000000001},"last":13.291}]},{"osd":1,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":18.352,"5min":26.658000000000001,"15min":23.210000000000001},"min":{"1min":5.6749999999999998,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":120.19799999999999,"5min":508.113,"15min":508.113},"last":9.5350000000000001},{"interface":"front","average":{"1min":14.755000000000001,"5min":21.356999999999999,"15min":19.134},"min":{"1min":6.5369999999999999,"5min":6.4210000000000003,"15min":5.1879999999999997},"max":{"1min":52.587000000000003,"5min":183.512,"15min":183.512},"last":17.510999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":23.193000000000001,"5min":26.809999999999999,"15min":22.952000000000002},"min":{"1min":7.0270000000000001,"5min":6.9059999999999997,"15min":6.3600000000000003},"max":{"1min":105.779,"5min":276.858,"15min":276.858},"last":11.406000000000001},{"interface":"front","average":{"1min":32.453000000000003,"5min":31.931999999999999,"15min":24.888999999999999},"min":{"1min":7.9779999999999998,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":252.52099999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":14.675000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":20.033000000000001,"5min":21.949999999999999,"15min":26.713000000000001},"min":{"1min":8.0079999999999991,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":66.866,"5min":77.144000000000005,"15min":327.39800000000002},"last":16.027999999999999},{"interface":"front","average":{"1min":23.605,"5min":27.524000000000001,"15min":29.152000000000001},"min":{"1min":7.7480000000000002,"5min":7.2220000000000004,"15min":6.8659999999999997},"max":{"1min":95.472999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":16.838999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:40:34 2023","interfaces":[{"interface":"back","average":{"1min":17.314,"5min":19.512,"15min":19.417999999999999},"min":{"1min":8.7159999999999993,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":59.195999999999998,"5min":125.809,"15min":303.637},"last":10.209},{"interface":"front","average":{"1min":21.106000000000002,"5min":25.699000000000002,"15min":25.07},"min":{"1min":10.291,"5min":9.1750000000000007,"15min":7.4169999999999998},"max":{"1min":67.885999999999996,"5min":188.06700000000001,"15min":304.79700000000003},"last":18.806000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":19.776,"5min":25.221,"15min":22.968},"min":{"1min":9.952,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":68.028000000000006,"5min":125.69,"15min":143.779},"last":12.413},{"interface":"front","average":{"1min":21.169,"5min":32.682000000000002,"15min":27.797000000000001},"min":{"1min":10.411,"5min":9.5719999999999992,"15min":8.4670000000000005},"max":{"1min":71.522999999999996,"5min":530.04300000000001,"15min":530.04300000000001},"last":8.6959999999999997}]},{"osd":7,"last update":"Wed Nov 1 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":22.713999999999999,"5min":31.914999999999999,"15min":26.495000000000001},"min":{"1min":12.776,"5min":8.2309999999999999,"15min":7.4710000000000001},"max":{"1min":69.022000000000006,"5min":319.23700000000002,"15min":319.23700000000002},"last":20.393999999999998},{"interface":"front","average":{"1min":21.402000000000001,"5min":29.286000000000001,"15min":24.658000000000001},"min":{"1min":10.721,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":57.826999999999998,"5min":193.06299999999999,"15min":193.06299999999999},"last":13.93}]}]},{"osd":4,"up_from":13,"seq":55834575122,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.542000000000002,"5min":14.725,"15min":17.497},"min":{"1min":4.8440000000000003,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":98.876000000000005,"5min":101.489,"15min":218.07300000000001},"last":10.018000000000001},{"interface":"front","average":{"1min":14.622999999999999,"5min":12.209,"15min":15.000999999999999},"min":{"1min":5.9889999999999999,"5min":5.3129999999999997,"15min":4.7670000000000003},"max":{"1min":111.852,"5min":111.852,"15min":180.934},"last":6.3479999999999999}]},{"osd":1,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":17.376000000000001,"5min":17.553999999999998,"15min":19.548999999999999},"min":{"1min":6.5350000000000001,"5min":6.3730000000000002,"15min":5.7309999999999999},"max":{"1min":97.834999999999994,"5min":231.58799999999999,"15min":237.00800000000001},"last":9.5399999999999991},{"interface":"front","average":{"1min":12.862,"5min":15.491,"15min":21.228999999999999},"min":{"1min":7.0250000000000004,"5min":5.468,"15min":5.468},"max":{"1min":45.398000000000003,"5min":160.93700000000001,"15min":237.965},"last":9.1059999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":16.260000000000002,"5min":19.155000000000001,"15min":23.353000000000002},"min":{"1min":8.327,"5min":6.9249999999999998,"15min":6.1890000000000001},"max":{"1min":41.594000000000001,"5min":189.38200000000001,"15min":317.30399999999997},"last":13.522},{"interface":"front","average":{"1min":16.364000000000001,"5min":21.843,"15min":22.341000000000001},"min":{"1min":8.532,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":51.375999999999998,"5min":260.46800000000002,"15min":260.46800000000002},"last":11.611000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":14.776,"5min":18.672000000000001,"15min":23.785},"min":{"1min":6.2530000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":54.658000000000001,"5min":165.47200000000001,"15min":421.14600000000002},"last":12.67},{"interface":"front","average":{"1min":19.300000000000001,"5min":19.853999999999999,"15min":26.306999999999999},"min":{"1min":8.3490000000000002,"5min":7.5960000000000001,"15min":7.1429999999999998},"max":{"1min":56.719999999999999,"5min":140.23099999999999,"15min":505.59199999999998},"last":17.140000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":18.914000000000001,"5min":20.149000000000001,"15min":25.367999999999999},"min":{"1min":7.5830000000000002,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":104.053,"5min":137.20500000000001,"15min":326.33499999999998},"last":14.712},{"interface":"front","average":{"1min":22.571000000000002,"5min":21.366,"15min":26.219000000000001},"min":{"1min":10.512,"5min":9.2110000000000003,"15min":8.7469999999999999},"max":{"1min":113.79900000000001,"5min":133.33000000000001,"15min":272.53399999999999},"last":15.448}]},{"osd":6,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":19.975000000000001,"5min":22.268000000000001,"15min":22.529},"min":{"1min":9.3900000000000006,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":79.174999999999997,"5min":350.44400000000002,"15min":350.44400000000002},"last":19.204999999999998},{"interface":"front","average":{"1min":24.341999999999999,"5min":26.786000000000001,"15min":28.228000000000002},"min":{"1min":14.526,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":100.511,"5min":351.82100000000003,"15min":351.82100000000003},"last":17.84}]},{"osd":7,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":14.221,"5min":17.978999999999999,"15min":22.213000000000001},"min":{"1min":8.8599999999999994,"5min":7.399,"15min":7.399},"max":{"1min":27.715,"5min":138.69900000000001,"15min":240.44200000000001},"last":14.1},{"interface":"front","average":{"1min":27.120999999999999,"5min":22.834,"15min":25.417999999999999},"min":{"1min":13.260999999999999,"5min":9.907,"15min":8.4299999999999997},"max":{"1min":101.629,"5min":122.86199999999999,"15min":256.74900000000002},"last":18.471}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:38.663 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.663 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.663 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.664 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.664 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.665 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-01T03:19:07.461885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=19, tm_sec=7, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.665 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2023-11-01T03:20:08.921874+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=305, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=1, tm_hour=3, tm_min=41, tm_sec=9, tm_wday=2, tm_yday=305, tm_isdst=0) 2023-11-01T03:41:38.665 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-01T03:41:48.035 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:49.345 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.040 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:49.350 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.057 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:49.367 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.093 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:49.403 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.093 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:49.365 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.095 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:49.367 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.096 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:49.406 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.108 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:49.380 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:48.109 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:49.419 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.063 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:59.373 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.067 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:59.377 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.080 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:23:59.390 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.115 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:59.386 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.117 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:59.389 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.118 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:59.428 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.119 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:59.429 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.129 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:23:59.400 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.131 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:23:59.441 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:41:58.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-01T03:41:58.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.780+0000 7f8683325640 10 monclient: get_monmap_and_config 2023-11-01T03:41:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.780+0000 7f8683325640 10 monclient: build_initial_monmap 2023-11-01T03:41:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.780+0000 7f8683325640 10 monclient: monmap: 2023-11-01T03:41:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:58.781 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:58.781057+0000 2023-11-01T03:41:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:58.781057+0000 2023-11-01T03:41:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.782 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:58.783 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:58.783 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.780+0000 7f8683325640 1 Processor -- start 2023-11-01T03:41:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 -- start start 2023-11-01T03:41:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient: init 2023-11-01T03:41:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2023-11-01T03:41:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f867c0b4240 addr v1:172.21.15.5:6789/0 2023-11-01T03:41:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): picked mon.noname-b con 0x7f867c0b38d0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f867c0ade00 0x7f867c13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:58.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): picked mon.noname-a con 0x7f867c0ade00 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0b0cc0 con 0x7f867c0b4240 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0b4620 con 0x7f867c0ade00 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0aeb80 con 0x7f867c0b38d0 2023-11-01T03:41:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:58.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.781+0000 7f8683325640 10 monclient(hunting): authenticate will time out at 2795.005898s 2023-11-01T03:41:58.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.785+0000 7f86808c0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49334/0 (socket says 172.21.15.5:49334) 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 1 -- 172.21.15.5:0/2915867958 learned_addr learned my addr 172.21.15.5:0/2915867958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 10 monclient(hunting): get_auth_request con 0x7f867c0b38d0 auth_method 0 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.788+0000 7f86808c0640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:58.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.790+0000 7f86808c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:58.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.790+0000 7f86808c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.790+0000 7f86808c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.790+0000 7f86818c2640 1 --2- 172.21.15.5:0/2915867958 >> v2:172.21.15.5:3300/0 conn(0x7f867c0ade00 0x7f867c13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86818c2640 10 monclient(hunting): get_auth_request con 0x7f867c0ade00 auth_method 0 2023-11-01T03:41:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86818c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86818c2640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86818c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 10 monclient(hunting): handle_auth_done global_id 17432 payload 274 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 1 -- 172.21.15.5:0/2915867958 >> v2:172.21.15.5:3300/0 conn(0x7f867c0ade00 msgr2=0x7f867c13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 1 --2- 172.21.15.5:0/2915867958 >> v2:172.21.15.5:3300/0 conn(0x7f867c0ade00 0x7f867c13b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 1 -- 172.21.15.5:0/2915867958 >> v1:172.21.15.5:6789/0 conn(0x7f867c0b4240 legacy=0x7f867c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 10 monclient: _finish_hunting 0 2023-11-01T03:41:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 1 monclient: found mon.noname-b 2023-11-01T03:41:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.5:3301/0 2023-11-01T03:41:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.794+0000 7f86808c0640 1 -- 172.21.15.5:0/2915867958 --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c13f5f0 con 0x7f867c0b38d0 2023-11-01T03:41:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.800+0000 7f86808c0640 1 --2- 172.21.15.5:0/2915867958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 secure :-1 s=READY pgs=2909 cs=0 l=1 rev1=1 crypto rx=0x7f866c009870 tx=0x7f866c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db60de3afbbbdf92 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 1 -- 172.21.15.5:0/2915867958 <== mon.2 v2:172.21.15.5:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c031640 con 0x7f867c0b38d0 2023-11-01T03:41:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: dump: 2023-11-01T03:41:58.814 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.815 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:58.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:58.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 1 -- 172.21.15.5:0/2915867958 <== mon.2 v2:172.21.15.5:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0317a0 con 0x7f867c0b38d0 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 1 -- 172.21.15.5:0/2915867958 <== mon.2 v2:172.21.15.5:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c031b30 con 0x7f867c0b38d0 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8683325640 5 monclient: authenticate success, global_id 17432 2023-11-01T03:41:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-01T03:41:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8673fff640 10 monclient: dump: 2023-11-01T03:41:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:58.818 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:58.820 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8683325640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:58.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.813+0000 7f8683325640 4 set_mon_vals no callback set 2023-11-01T03:41:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 10 monclient: shutdown 2023-11-01T03:41:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 -- 172.21.15.5:0/2915867958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 msgr2=0x7f867c0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 --2- 172.21.15.5:0/2915867958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 secure :-1 s=READY pgs=2909 cs=0 l=1 rev1=1 crypto rx=0x7f866c009870 tx=0x7f866c02b8f0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 -- 172.21.15.5:0/2915867958 shutdown_connections 2023-11-01T03:41:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 --2- 172.21.15.5:0/2915867958 >> v2:172.21.15.5:3300/0 conn(0x7f867c0ade00 0x7f867c13b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 --2- 172.21.15.5:0/2915867958 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b38d0 0x7f867c0ae640 unknown :-1 s=CLOSED pgs=2909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 -- 172.21.15.5:0/2915867958 >> 172.21.15.5:0/2915867958 conn(0x7f867c065cd0 msgr2=0x7f867c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 -- 172.21.15.5:0/2915867958 shutdown_connections 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.814+0000 7f8683325640 1 -- 172.21.15.5:0/2915867958 wait complete. 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 10 monclient: build_initial_monmap 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 10 monclient: monmap: 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 librados: starting msgr at 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 librados: starting objecter 2023-11-01T03:41:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 Processor -- start 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 -- start start 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 librados: setting wanted keys 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 1 librados: calling monclient init 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 10 monclient: init 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.815+0000 7f8683325640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:41:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867c0ade00 0x7f867c13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): picked mon.noname-a con 0x7f867c0ade00 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b4240 0x7f867c137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): picked mon.noname-c con 0x7f867c0b4240 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): picked mon.noname-b con 0x7f867c144ea0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c145430 con 0x7f867c0ade00 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0a8fd0 con 0x7f867c144ea0 2023-11-01T03:41:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c145850 con 0x7f867c0b4240 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f8683325640 10 monclient(hunting): authenticate will time out at 2795.040063s 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.816+0000 7f86818c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86810c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867c0ade00 0x7f867c13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.5:53194/0 (socket says 172.21.15.5:53194) 2023-11-01T03:41:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 1 -- 172.21.15.5:0/1226438808 learned_addr learned my addr 172.21.15.5:0/1226438808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): get_auth_request con 0x7f867c144ea0 auth_method 0 2023-11-01T03:41:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.817+0000 7f86818c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.818+0000 7f86810c1640 10 monclient(hunting): get_auth_request con 0x7f867c0ade00 auth_method 0 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.818+0000 7f86810c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.818+0000 7f86810c1640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.818+0000 7f86810c1640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 10 monclient(hunting): handle_auth_done global_id 22261 payload 824 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 -- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b4240 msgr2=0x7f867c137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b4240 0x7f867c137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 -- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867c0ade00 msgr2=0x7f867c13dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867c0ade00 0x7f867c13dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 10 monclient: _finish_hunting 0 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 monclient: found mon.noname-b 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.820+0000 7f86818c2640 1 -- 172.21.15.5:0/1226438808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0094d0 con 0x7f867c144ea0 2023-11-01T03:41:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.822+0000 7f86818c2640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 secure :-1 s=READY pgs=5573 cs=0 l=1 rev1=1 crypto rx=0x7f8674007e60 tx=0x7f867400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.822+0000 7f8671ffb640 10 client.?.objecter ms_handle_connect 0x7f867c144ea0 2023-11-01T03:41:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.822+0000 7f8671ffb640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674014620 con 0x7f867c144ea0 2023-11-01T03:41:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: dump: 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: _finish_auth 0 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: _check_auth_tickets 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674014780 con 0x7f867c144ea0 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 5 monclient: authenticate success, global_id 22261 2023-11-01T03:41:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 10 monclient: _renew_subs 2023-11-01T03:41:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c13e9f0 con 0x7f867c144ea0 2023-11-01T03:41:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674014b30 con 0x7f867c144ea0 2023-11-01T03:41:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8671ffb640 10 monclient: dump: 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f86737fe640 4 set_mon_vals no callback set 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 10 client.22261.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 10 monclient: _renew_subs 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c144c10 con 0x7f867c144ea0 2023-11-01T03:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.826+0000 7f8683325640 1 librados: init done 2023-11-01T03:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.827+0000 7f8683325640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.827+0000 7f8683325640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.827+0000 7f8683325640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:58.827+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c145570 con 0x7f867c144ea0 2023-11-01T03:41:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.069+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8674014c90 con 0x7f867c144ea0 2023-11-01T03:41:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.069+0000 7f8671ffb640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 0x7f866006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.069+0000 7f86810c1640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 0x7f866006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.069+0000 7f86810c1640 10 monclient: get_auth_request con 0x7f866006c800 auth_method 0 2023-11-01T03:41:59.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.070+0000 7f8671ffb640 10 client.22261.objecter ms_handle_connect 0x7f866006c800 2023-11-01T03:41:59.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.070+0000 7f86810c1640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 0x7f866006ecc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8678000f60 tx=0x7f8678009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.071+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8674059da0 con 0x7f867c144ea0 2023-11-01T03:41:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.071+0000 7f8671ffb640 10 client.22261.objecter ms_dispatch 0x7f867c000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.071+0000 7f8671ffb640 3 client.22261.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.071+0000 7f8671ffb640 3 client.22261.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.071+0000 7f8671ffb640 20 client.22261.objecter dump_active .. 0 homeless 2023-11-01T03:41:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.081+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8674088e60 con 0x7f867c144ea0 2023-11-01T03:41:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.081+0000 7f8671ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.081+0000 7f8671ffb640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.256+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 --> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f867c145570 con 0x7f866006c800 2023-11-01T03:41:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.260+0000 7f8671ffb640 1 -- 172.21.15.5:0/1226438808 <== mgr.4105 v2:172.21.15.5:6800/1571677761 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+152031 (secure 0 0 0) 0x7f867c145570 con 0x7f866006c800 2023-11-01T03:41:59.264 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-01T03:41:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-11-01T03:41:59.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.262+0000 7f8683325640 10 librados: watch_flush enter 2023-11-01T03:41:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.262+0000 7f8683325640 10 librados: watch_flush exit 2023-11-01T03:41:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 20 client.22261.objecter shutdown clearing up homeless session... 2023-11-01T03:41:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 10 client.22261.objecter successfully canceled tick 2023-11-01T03:41:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 msgr2=0x7f866006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 0x7f866006ecc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8678000f60 tx=0x7f8678009040 comp rx=0 tx=0).stop 2023-11-01T03:41:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 10 monclient: shutdown 2023-11-01T03:41:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 msgr2=0x7f867c137890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 secure :-1 s=READY pgs=5573 cs=0 l=1 rev1=1 crypto rx=0x7f8674007e60 tx=0x7f867400e4b0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 shutdown_connections 2023-11-01T03:41:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f866006c800 0x7f866006ecc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f867c144ea0 0x7f867c137890 unknown :-1 s=CLOSED pgs=5573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f867c0b4240 0x7f867c137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 --2- 172.21.15.5:0/1226438808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f867c0ade00 0x7f867c13dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 >> 172.21.15.5:0/1226438808 conn(0x7f867c065cd0 msgr2=0x7f867c0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 shutdown_connections 2023-11-01T03:41:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 -- 172.21.15.5:0/1226438808 wait complete. 2023-11-01T03:41:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.263+0000 7f8683325640 1 librados: shutdown 2023-11-01T03:41:59.274 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1596,"stamp":"2023-11-01T03:41:57.520620+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":554776,"kb_used_data":43032,"kb_used_omap":12,"kb_used_meta":511667,"kb_avail":754419944,"statfs":{"total":773094113280,"available":772526022656,"internally_reserved":0,"allocated":44064768,"data_stored":23660274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":523947577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003098"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:47.326123+0000","last_change":"2023-11-01T03:41:47.326123+0000","last_active":"2023-11-01T03:41:47.326123+0000","last_peered":"2023-11-01T03:41:47.326123+0000","last_clean":"2023-11-01T03:41:47.326123+0000","last_became_active":"2023-11-01T03:20:28.987339+0000","last_became_peered":"2023-11-01T03:20:28.987339+0000","last_unstale":"2023-11-01T03:41:47.326123+0000","last_undegraded":"2023-11-01T03:41:47.326123+0000","last_fullsized":"2023-11-01T03:41:47.326123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:47.323405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:47.323405+0000","last_clean_scrub_stamp":"2023-11-01T03:41:47.323405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:41:11.096742+0000","scrub_duration":0.048027064000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":875,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:34.851314+0000","last_change":"2023-11-01T03:41:34.855562+0000","last_active":"2023-11-01T03:41:34.851314+0000","last_peered":"2023-11-01T03:41:34.851314+0000","last_clean":"2023-11-01T03:41:34.851314+0000","last_became_active":"2023-11-01T03:20:21.269916+0000","last_became_peered":"2023-11-01T03:20:21.269916+0000","last_unstale":"2023-11-01T03:41:34.851314+0000","last_undegraded":"2023-11-01T03:41:34.851314+0000","last_fullsized":"2023-11-01T03:41:34.851314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:34.849823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:34.849823+0000","last_clean_scrub_stamp":"2023-11-01T03:41:34.849823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:23:38.046261+0000","scrub_duration":0.029061514,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":861,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.608665+0000","last_change":"2023-11-01T03:41:22.609839+0000","last_active":"2023-11-01T03:41:22.608665+0000","last_peered":"2023-11-01T03:41:22.608665+0000","last_clean":"2023-11-01T03:41:22.608665+0000","last_became_active":"2023-11-01T03:20:24.840882+0000","last_became_peered":"2023-11-01T03:20:24.840882+0000","last_unstale":"2023-11-01T03:41:22.608665+0000","last_undegraded":"2023-11-01T03:41:22.608665+0000","last_fullsized":"2023-11-01T03:41:22.608665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.607221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.607221+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.607221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:52:28.157328+0000","scrub_duration":0.067490516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.029175+0000","last_change":"2023-11-01T03:41:19.030306+0000","last_active":"2023-11-01T03:41:19.029175+0000","last_peered":"2023-11-01T03:41:19.029175+0000","last_clean":"2023-11-01T03:41:19.029175+0000","last_became_active":"2023-11-01T03:20:28.955755+0000","last_became_peered":"2023-11-01T03:20:28.955755+0000","last_unstale":"2023-11-01T03:41:19.029175+0000","last_undegraded":"2023-11-01T03:41:19.029175+0000","last_fullsized":"2023-11-01T03:41:19.029175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.027704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.027704+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.027704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:04:14.082213+0000","scrub_duration":0.062122528000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:34.366082+0000","last_change":"2023-11-01T03:41:34.367206+0000","last_active":"2023-11-01T03:41:34.366082+0000","last_peered":"2023-11-01T03:41:34.366082+0000","last_clean":"2023-11-01T03:41:34.366082+0000","last_became_active":"2023-11-01T03:20:14.748318+0000","last_became_peered":"2023-11-01T03:20:14.748318+0000","last_unstale":"2023-11-01T03:41:34.366082+0000","last_undegraded":"2023-11-01T03:41:34.366082+0000","last_fullsized":"2023-11-01T03:41:34.366082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:34.364630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:34.364630+0000","last_clean_scrub_stamp":"2023-11-01T03:41:34.364630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:57:15.794103+0000","scrub_duration":0.040608394999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.809357+0000","last_change":"2023-11-01T03:41:19.813683+0000","last_active":"2023-11-01T03:41:19.809357+0000","last_peered":"2023-11-01T03:41:19.809357+0000","last_clean":"2023-11-01T03:41:19.809357+0000","last_became_active":"2023-11-01T03:20:19.029179+0000","last_became_peered":"2023-11-01T03:20:19.029179+0000","last_unstale":"2023-11-01T03:41:19.809357+0000","last_undegraded":"2023-11-01T03:41:19.809357+0000","last_fullsized":"2023-11-01T03:41:19.809357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.807766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.807766+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.807766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:23:21.565914+0000","scrub_duration":0.050759169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:20.753735+0000","last_change":"2023-11-01T03:41:20.761325+0000","last_active":"2023-11-01T03:41:20.753735+0000","last_peered":"2023-11-01T03:41:20.753735+0000","last_clean":"2023-11-01T03:41:20.753735+0000","last_became_active":"2023-11-01T03:21:04.923082+0000","last_became_peered":"2023-11-01T03:21:04.923082+0000","last_unstale":"2023-11-01T03:41:20.753735+0000","last_undegraded":"2023-11-01T03:41:20.753735+0000","last_fullsized":"2023-11-01T03:41:20.753735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:20.747001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:20.747001+0000","last_clean_scrub_stamp":"2023-11-01T03:41:20.747001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:41:29.773625+0000","scrub_duration":0.227008341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.836598+0000","last_change":"2023-11-01T03:41:15.836598+0000","last_active":"2023-11-01T03:41:15.836598+0000","last_peered":"2023-11-01T03:41:15.836598+0000","last_clean":"2023-11-01T03:41:15.836598+0000","last_became_active":"2023-11-01T03:20:17.027131+0000","last_became_peered":"2023-11-01T03:20:17.027131+0000","last_unstale":"2023-11-01T03:41:15.836598+0000","last_undegraded":"2023-11-01T03:41:15.836598+0000","last_fullsized":"2023-11-01T03:41:15.836598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:15.834047+0000","last_clean_scrub_stamp":"2023-11-01T03:41:15.834047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:23:54.174101+0000","scrub_duration":0.045577138000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":877,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.243014+0000","last_change":"2023-11-01T03:41:22.244321+0000","last_active":"2023-11-01T03:41:22.243014+0000","last_peered":"2023-11-01T03:41:22.243014+0000","last_clean":"2023-11-01T03:41:22.243014+0000","last_became_active":"2023-11-01T03:20:21.301021+0000","last_became_peered":"2023-11-01T03:20:21.301021+0000","last_unstale":"2023-11-01T03:41:22.243014+0000","last_undegraded":"2023-11-01T03:41:22.243014+0000","last_fullsized":"2023-11-01T03:41:22.243014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.241591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.241591+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.241591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:12:56.650283+0000","scrub_duration":0.067804724999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":874,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.742199+0000","last_change":"2023-11-01T03:41:28.743288+0000","last_active":"2023-11-01T03:41:28.742199+0000","last_peered":"2023-11-01T03:41:28.742199+0000","last_clean":"2023-11-01T03:41:28.742199+0000","last_became_active":"2023-11-01T03:20:21.247835+0000","last_became_peered":"2023-11-01T03:20:21.247835+0000","last_unstale":"2023-11-01T03:41:28.742199+0000","last_undegraded":"2023-11-01T03:41:28.742199+0000","last_fullsized":"2023-11-01T03:41:28.742199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.740816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.740816+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.740816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:58:14.728298+0000","scrub_duration":0.026975186000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:30.260228+0000","last_change":"2023-11-01T03:41:30.261313+0000","last_active":"2023-11-01T03:41:30.260228+0000","last_peered":"2023-11-01T03:41:30.260228+0000","last_clean":"2023-11-01T03:41:30.260228+0000","last_became_active":"2023-11-01T03:20:24.016701+0000","last_became_peered":"2023-11-01T03:20:24.016701+0000","last_unstale":"2023-11-01T03:41:30.260228+0000","last_undegraded":"2023-11-01T03:41:30.260228+0000","last_fullsized":"2023-11-01T03:41:30.260228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:30.258819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:30.258819+0000","last_clean_scrub_stamp":"2023-11-01T03:41:30.258819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:33:40.216568+0000","scrub_duration":0.072408410000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.208808+0000","last_change":"2023-11-01T03:41:19.213004+0000","last_active":"2023-11-01T03:41:19.208808+0000","last_peered":"2023-11-01T03:41:19.208808+0000","last_clean":"2023-11-01T03:41:19.208808+0000","last_became_active":"2023-11-01T03:20:25.922852+0000","last_became_peered":"2023-11-01T03:20:25.922852+0000","last_unstale":"2023-11-01T03:41:19.208808+0000","last_undegraded":"2023-11-01T03:41:19.208808+0000","last_fullsized":"2023-11-01T03:41:19.208808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.207456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.207456+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.207456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:14:09.998506+0000","scrub_duration":0.051797727000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:27.214545+0000","last_change":"2023-11-01T03:41:27.215561+0000","last_active":"2023-11-01T03:41:27.214545+0000","last_peered":"2023-11-01T03:41:27.214545+0000","last_clean":"2023-11-01T03:41:27.214545+0000","last_became_active":"2023-11-01T03:20:21.127312+0000","last_became_peered":"2023-11-01T03:20:21.127312+0000","last_unstale":"2023-11-01T03:41:27.214545+0000","last_undegraded":"2023-11-01T03:41:27.214545+0000","last_fullsized":"2023-11-01T03:41:27.214545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:27.213220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:27.213220+0000","last_clean_scrub_stamp":"2023-11-01T03:41:27.213220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:19:36.334781+0000","scrub_duration":0.035011131000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.392319+0000","last_change":"2023-11-01T03:41:28.396377+0000","last_active":"2023-11-01T03:41:28.392319+0000","last_peered":"2023-11-01T03:41:28.392319+0000","last_clean":"2023-11-01T03:41:28.392319+0000","last_became_active":"2023-11-01T03:19:09.858461+0000","last_became_peered":"2023-11-01T03:19:09.858461+0000","last_unstale":"2023-11-01T03:41:28.392319+0000","last_undegraded":"2023-11-01T03:41:28.392319+0000","last_fullsized":"2023-11-01T03:41:28.392319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.390830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.390830+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.390830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:47:34.121091+0000","scrub_duration":0.049869262999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:35.431123+0000","last_change":"2023-11-01T03:41:35.432353+0000","last_active":"2023-11-01T03:41:35.431123+0000","last_peered":"2023-11-01T03:41:35.431123+0000","last_clean":"2023-11-01T03:41:35.431123+0000","last_became_active":"2023-11-01T03:20:20.622697+0000","last_became_peered":"2023-11-01T03:20:20.622697+0000","last_unstale":"2023-11-01T03:41:35.431123+0000","last_undegraded":"2023-11-01T03:41:35.431123+0000","last_fullsized":"2023-11-01T03:41:35.431123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:35.429508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:35.429508+0000","last_clean_scrub_stamp":"2023-11-01T03:41:35.429508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:18:30.454907+0000","scrub_duration":0.063273737999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":867,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.064270+0000","last_change":"2023-11-01T03:41:18.065342+0000","last_active":"2023-11-01T03:41:18.064270+0000","last_peered":"2023-11-01T03:41:18.064270+0000","last_clean":"2023-11-01T03:41:18.064270+0000","last_became_active":"2023-11-01T03:19:09.874526+0000","last_became_peered":"2023-11-01T03:19:09.874526+0000","last_unstale":"2023-11-01T03:41:18.064270+0000","last_undegraded":"2023-11-01T03:41:18.064270+0000","last_fullsized":"2023-11-01T03:41:18.064270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.062849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.062849+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.062849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:25:54.581361+0000","scrub_duration":0.038207484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.536554+0000","last_change":"2023-11-01T03:41:26.537687+0000","last_active":"2023-11-01T03:41:26.536554+0000","last_peered":"2023-11-01T03:41:26.536554+0000","last_clean":"2023-11-01T03:41:26.536554+0000","last_became_active":"2023-11-01T03:20:22.248486+0000","last_became_peered":"2023-11-01T03:20:22.248486+0000","last_unstale":"2023-11-01T03:41:26.536554+0000","last_undegraded":"2023-11-01T03:41:26.536554+0000","last_fullsized":"2023-11-01T03:41:26.536554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.535072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.535072+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.535072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:07:11.883867+0000","scrub_duration":0.037739649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:27.335631+0000","last_change":"2023-11-01T03:41:27.336749+0000","last_active":"2023-11-01T03:41:27.335631+0000","last_peered":"2023-11-01T03:41:27.335631+0000","last_clean":"2023-11-01T03:41:27.335631+0000","last_became_active":"2023-11-01T03:19:09.148662+0000","last_became_peered":"2023-11-01T03:19:09.148662+0000","last_unstale":"2023-11-01T03:41:27.335631+0000","last_undegraded":"2023-11-01T03:41:27.335631+0000","last_fullsized":"2023-11-01T03:41:27.335631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:27.334219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:27.334219+0000","last_clean_scrub_stamp":"2023-11-01T03:41:27.334219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:26:51.046274+0000","scrub_duration":0.033472364999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.585127+0000","last_change":"2023-11-01T03:41:21.586810+0000","last_active":"2023-11-01T03:41:21.585127+0000","last_peered":"2023-11-01T03:41:21.585127+0000","last_clean":"2023-11-01T03:41:21.585127+0000","last_became_active":"2023-11-01T03:20:24.782404+0000","last_became_peered":"2023-11-01T03:20:24.782404+0000","last_unstale":"2023-11-01T03:41:21.585127+0000","last_undegraded":"2023-11-01T03:41:21.585127+0000","last_fullsized":"2023-11-01T03:41:21.585127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.581386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.581386+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.581386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:30:24.248816+0000","scrub_duration":0.084317545999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":880,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:16.795870+0000","last_change":"2023-11-01T03:41:16.797017+0000","last_active":"2023-11-01T03:41:16.795870+0000","last_peered":"2023-11-01T03:41:16.795870+0000","last_clean":"2023-11-01T03:41:16.795870+0000","last_became_active":"2023-11-01T03:19:09.776591+0000","last_became_peered":"2023-11-01T03:19:09.776591+0000","last_unstale":"2023-11-01T03:41:16.795870+0000","last_undegraded":"2023-11-01T03:41:16.795870+0000","last_fullsized":"2023-11-01T03:41:16.795870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:16.794332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:16.794332+0000","last_clean_scrub_stamp":"2023-11-01T03:41:16.794332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:55:12.831029+0000","scrub_duration":0.034160994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":875,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:20.793341+0000","last_change":"2023-11-01T03:41:20.794355+0000","last_active":"2023-11-01T03:41:20.793341+0000","last_peered":"2023-11-01T03:41:20.793341+0000","last_clean":"2023-11-01T03:41:20.793341+0000","last_became_active":"2023-11-01T03:20:38.477720+0000","last_became_peered":"2023-11-01T03:20:38.477720+0000","last_unstale":"2023-11-01T03:41:20.793341+0000","last_undegraded":"2023-11-01T03:41:20.793341+0000","last_fullsized":"2023-11-01T03:41:20.793341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:20.791954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:20.791954+0000","last_clean_scrub_stamp":"2023-11-01T03:41:20.791954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:15:29.287607+0000","scrub_duration":0.039221280999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.310702+0000","last_change":"2023-11-01T03:41:21.311839+0000","last_active":"2023-11-01T03:41:21.310702+0000","last_peered":"2023-11-01T03:41:21.310702+0000","last_clean":"2023-11-01T03:41:21.310702+0000","last_became_active":"2023-11-01T03:19:09.761022+0000","last_became_peered":"2023-11-01T03:19:09.761022+0000","last_unstale":"2023-11-01T03:41:21.310702+0000","last_undegraded":"2023-11-01T03:41:21.310702+0000","last_fullsized":"2023-11-01T03:41:21.310702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.309281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.309281+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.309281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:48:22.183527+0000","scrub_duration":0.032314994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:13.923450+0000","last_change":"2023-11-01T03:41:13.923450+0000","last_active":"2023-11-01T03:41:13.923450+0000","last_peered":"2023-11-01T03:41:13.923450+0000","last_clean":"2023-11-01T03:41:13.923450+0000","last_became_active":"2023-11-01T03:20:28.704475+0000","last_became_peered":"2023-11-01T03:20:28.704475+0000","last_unstale":"2023-11-01T03:41:13.923450+0000","last_undegraded":"2023-11-01T03:41:13.923450+0000","last_fullsized":"2023-11-01T03:41:13.923450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:13.920800+0000","last_clean_scrub_stamp":"2023-11-01T03:41:13.920800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T07:15:49.893573+0000","scrub_duration":0.074463761000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":868,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.131442+0000","last_change":"2023-11-01T03:41:21.132489+0000","last_active":"2023-11-01T03:41:21.131442+0000","last_peered":"2023-11-01T03:41:21.131442+0000","last_clean":"2023-11-01T03:41:21.131442+0000","last_became_active":"2023-11-01T03:19:08.966805+0000","last_became_peered":"2023-11-01T03:19:08.966805+0000","last_unstale":"2023-11-01T03:41:21.131442+0000","last_undegraded":"2023-11-01T03:41:21.131442+0000","last_fullsized":"2023-11-01T03:41:21.131442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.130059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.130059+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.130059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:38:54.898182+0000","scrub_duration":0.030713909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":875,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:37.906338+0000","last_change":"2023-11-01T03:41:37.911840+0000","last_active":"2023-11-01T03:41:37.906338+0000","last_peered":"2023-11-01T03:41:37.906338+0000","last_clean":"2023-11-01T03:41:37.906338+0000","last_became_active":"2023-11-01T03:20:27.819136+0000","last_became_peered":"2023-11-01T03:20:27.819136+0000","last_unstale":"2023-11-01T03:41:37.906338+0000","last_undegraded":"2023-11-01T03:41:37.906338+0000","last_fullsized":"2023-11-01T03:41:37.906338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:37.904256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:37.904256+0000","last_clean_scrub_stamp":"2023-11-01T03:41:37.904256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T04:33:54.428585+0000","scrub_duration":0.063025175000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":873,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.324911+0000","last_change":"2023-11-01T03:41:26.326053+0000","last_active":"2023-11-01T03:41:26.324911+0000","last_peered":"2023-11-01T03:41:26.324911+0000","last_clean":"2023-11-01T03:41:26.324911+0000","last_became_active":"2023-11-01T03:19:09.075090+0000","last_became_peered":"2023-11-01T03:19:09.075090+0000","last_unstale":"2023-11-01T03:41:26.324911+0000","last_undegraded":"2023-11-01T03:41:26.324911+0000","last_fullsized":"2023-11-01T03:41:26.324911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.323445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.323445+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.323445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:19:14.833218+0000","scrub_duration":0.043073855000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":876,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.769192+0000","last_change":"2023-11-01T03:41:18.769192+0000","last_active":"2023-11-01T03:41:18.769192+0000","last_peered":"2023-11-01T03:41:18.769192+0000","last_clean":"2023-11-01T03:41:18.769192+0000","last_became_active":"2023-11-01T03:20:25.556095+0000","last_became_peered":"2023-11-01T03:20:25.556095+0000","last_unstale":"2023-11-01T03:41:18.769192+0000","last_undegraded":"2023-11-01T03:41:18.769192+0000","last_fullsized":"2023-11-01T03:41:18.769192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.766658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.766658+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.766658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:42:44.290200+0000","scrub_duration":0.028759040999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":872,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:33.393231+0000","last_change":"2023-11-01T03:41:33.394350+0000","last_active":"2023-11-01T03:41:33.393231+0000","last_peered":"2023-11-01T03:41:33.393231+0000","last_clean":"2023-11-01T03:41:33.393231+0000","last_became_active":"2023-11-01T03:19:09.690609+0000","last_became_peered":"2023-11-01T03:19:09.690609+0000","last_unstale":"2023-11-01T03:41:33.393231+0000","last_undegraded":"2023-11-01T03:41:33.393231+0000","last_fullsized":"2023-11-01T03:41:33.393231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:33.391725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:33.391725+0000","last_clean_scrub_stamp":"2023-11-01T03:41:33.391725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:56:38.880866+0000","scrub_duration":0.033503099000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"902'78","reported_seq":976,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:12.949854+0000","last_change":"2023-11-01T03:41:12.955879+0000","last_active":"2023-11-01T03:41:12.949854+0000","last_peered":"2023-11-01T03:41:12.949854+0000","last_clean":"2023-11-01T03:41:12.949854+0000","last_became_active":"2023-11-01T03:19:01.840810+0000","last_became_peered":"2023-11-01T03:19:01.840810+0000","last_unstale":"2023-11-01T03:41:12.949854+0000","last_undegraded":"2023-11-01T03:41:12.949854+0000","last_fullsized":"2023-11-01T03:41:12.949854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"902'78","last_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_deep_scrub":"902'78","last_deep_scrub_stamp":"2023-11-01T03:41:12.948002+0000","last_clean_scrub_stamp":"2023-11-01T03:41:12.948002+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:01:43.692010+0000","scrub_duration":0.15311366100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":879,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:25.191809+0000","last_change":"2023-11-01T03:41:25.192853+0000","last_active":"2023-11-01T03:41:25.191809+0000","last_peered":"2023-11-01T03:41:25.191809+0000","last_clean":"2023-11-01T03:41:25.191809+0000","last_became_active":"2023-11-01T03:20:23.764968+0000","last_became_peered":"2023-11-01T03:20:23.764968+0000","last_unstale":"2023-11-01T03:41:25.191809+0000","last_undegraded":"2023-11-01T03:41:25.191809+0000","last_fullsized":"2023-11-01T03:41:25.191809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:25.190412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:25.190412+0000","last_clean_scrub_stamp":"2023-11-01T03:41:25.190412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:12:37.179116+0000","scrub_duration":0.028020638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:15.010935+0000","last_change":"2023-11-01T03:41:15.013832+0000","last_active":"2023-11-01T03:41:15.010935+0000","last_peered":"2023-11-01T03:41:15.010935+0000","last_clean":"2023-11-01T03:41:15.010935+0000","last_became_active":"2023-11-01T03:20:16.614018+0000","last_became_peered":"2023-11-01T03:20:16.614018+0000","last_unstale":"2023-11-01T03:41:15.010935+0000","last_undegraded":"2023-11-01T03:41:15.010935+0000","last_fullsized":"2023-11-01T03:41:15.010935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:15.005965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:15.005965+0000","last_clean_scrub_stamp":"2023-11-01T03:41:15.005965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:05:57.909338+0000","scrub_duration":0.067646097000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":876,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:35.819679+0000","last_change":"2023-11-01T03:41:35.820700+0000","last_active":"2023-11-01T03:41:35.819679+0000","last_peered":"2023-11-01T03:41:35.819679+0000","last_clean":"2023-11-01T03:41:35.819679+0000","last_became_active":"2023-11-01T03:20:27.622190+0000","last_became_peered":"2023-11-01T03:20:27.622190+0000","last_unstale":"2023-11-01T03:41:35.819679+0000","last_undegraded":"2023-11-01T03:41:35.819679+0000","last_fullsized":"2023-11-01T03:41:35.819679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:35.818282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:35.818282+0000","last_clean_scrub_stamp":"2023-11-01T03:41:35.818282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T05:41:10.917247+0000","scrub_duration":0.031637091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"902'8","reported_seq":878,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:23.243704+0000","last_change":"2023-11-01T03:41:23.244943+0000","last_active":"2023-11-01T03:41:23.243704+0000","last_peered":"2023-11-01T03:41:23.243704+0000","last_clean":"2023-11-01T03:41:23.243704+0000","last_became_active":"2023-11-01T03:20:16.761588+0000","last_became_peered":"2023-11-01T03:20:16.761588+0000","last_unstale":"2023-11-01T03:41:23.243704+0000","last_undegraded":"2023-11-01T03:41:23.243704+0000","last_fullsized":"2023-11-01T03:41:23.243704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"902'8","last_scrub_stamp":"2023-11-01T03:41:23.242282+0000","last_deep_scrub":"902'8","last_deep_scrub_stamp":"2023-11-01T03:41:23.242282+0000","last_clean_scrub_stamp":"2023-11-01T03:41:23.242282+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T13:34:50.828622+0000","scrub_duration":0.080150692999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":865,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:23.548514+0000","last_change":"2023-11-01T03:41:23.548514+0000","last_active":"2023-11-01T03:41:23.548514+0000","last_peered":"2023-11-01T03:41:23.548514+0000","last_clean":"2023-11-01T03:41:23.548514+0000","last_became_active":"2023-11-01T03:20:20.683566+0000","last_became_peered":"2023-11-01T03:20:20.683566+0000","last_unstale":"2023-11-01T03:41:23.548514+0000","last_undegraded":"2023-11-01T03:41:23.548514+0000","last_fullsized":"2023-11-01T03:41:23.548514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:23.543658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:23.543658+0000","last_clean_scrub_stamp":"2023-11-01T03:41:23.543658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T12:00:04.199103+0000","scrub_duration":0.039640505999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:30.588259+0000","last_change":"2023-11-01T03:41:30.588259+0000","last_active":"2023-11-01T03:41:30.588259+0000","last_peered":"2023-11-01T03:41:30.588259+0000","last_clean":"2023-11-01T03:41:30.588259+0000","last_became_active":"2023-11-01T03:20:31.340795+0000","last_became_peered":"2023-11-01T03:20:31.340795+0000","last_unstale":"2023-11-01T03:41:30.588259+0000","last_undegraded":"2023-11-01T03:41:30.588259+0000","last_fullsized":"2023-11-01T03:41:30.588259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:30.585653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:30.585653+0000","last_clean_scrub_stamp":"2023-11-01T03:41:30.585653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:59:24.283570+0000","scrub_duration":0.063269760999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":864,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:26.211239+0000","last_change":"2023-11-01T03:41:26.212296+0000","last_active":"2023-11-01T03:41:26.211239+0000","last_peered":"2023-11-01T03:41:26.211239+0000","last_clean":"2023-11-01T03:41:26.211239+0000","last_became_active":"2023-11-01T03:20:15.795272+0000","last_became_peered":"2023-11-01T03:20:15.795272+0000","last_unstale":"2023-11-01T03:41:26.211239+0000","last_undegraded":"2023-11-01T03:41:26.211239+0000","last_fullsized":"2023-11-01T03:41:26.211239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:26.209830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:26.209830+0000","last_clean_scrub_stamp":"2023-11-01T03:41:26.209830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T15:27:59.206763+0000","scrub_duration":0.035157349999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":876,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:22.787595+0000","last_change":"2023-11-01T03:41:22.788630+0000","last_active":"2023-11-01T03:41:22.787595+0000","last_peered":"2023-11-01T03:41:22.787595+0000","last_clean":"2023-11-01T03:41:22.787595+0000","last_became_active":"2023-11-01T03:20:38.729345+0000","last_became_peered":"2023-11-01T03:20:38.729345+0000","last_unstale":"2023-11-01T03:41:22.787595+0000","last_undegraded":"2023-11-01T03:41:22.787595+0000","last_fullsized":"2023-11-01T03:41:22.787595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:22.786190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:22.786190+0000","last_clean_scrub_stamp":"2023-11-01T03:41:22.786190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:17:44.340781+0000","scrub_duration":0.046937324000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":874,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:21.764092+0000","last_change":"2023-11-01T03:41:21.765146+0000","last_active":"2023-11-01T03:41:21.764092+0000","last_peered":"2023-11-01T03:41:21.764092+0000","last_clean":"2023-11-01T03:41:21.764092+0000","last_became_active":"2023-11-01T03:20:21.840466+0000","last_became_peered":"2023-11-01T03:20:21.840466+0000","last_unstale":"2023-11-01T03:41:21.764092+0000","last_undegraded":"2023-11-01T03:41:21.764092+0000","last_fullsized":"2023-11-01T03:41:21.764092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:21.762677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:21.762677+0000","last_clean_scrub_stamp":"2023-11-01T03:41:21.762677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T11:42:42.807809+0000","scrub_duration":0.033273957999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":862,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:19.088954+0000","last_change":"2023-11-01T03:41:19.090062+0000","last_active":"2023-11-01T03:41:19.088954+0000","last_peered":"2023-11-01T03:41:19.088954+0000","last_clean":"2023-11-01T03:41:19.088954+0000","last_became_active":"2023-11-01T03:20:21.935761+0000","last_became_peered":"2023-11-01T03:20:21.935761+0000","last_unstale":"2023-11-01T03:41:19.088954+0000","last_undegraded":"2023-11-01T03:41:19.088954+0000","last_fullsized":"2023-11-01T03:41:19.088954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:19.087591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:19.087591+0000","last_clean_scrub_stamp":"2023-11-01T03:41:19.087591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T06:13:48.007253+0000","scrub_duration":0.056343228000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":863,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:28.595970+0000","last_change":"2023-11-01T03:41:28.601458+0000","last_active":"2023-11-01T03:41:28.595970+0000","last_peered":"2023-11-01T03:41:28.595970+0000","last_clean":"2023-11-01T03:41:28.595970+0000","last_became_active":"2023-11-01T03:20:31.320408+0000","last_became_peered":"2023-11-01T03:20:31.320408+0000","last_unstale":"2023-11-01T03:41:28.595970+0000","last_undegraded":"2023-11-01T03:41:28.595970+0000","last_fullsized":"2023-11-01T03:41:28.595970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:28.594482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:28.594482+0000","last_clean_scrub_stamp":"2023-11-01T03:41:28.594482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T10:02:22.506742+0000","scrub_duration":0.036296297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":877,"reported_epoch":902,"state":"active+clean","last_fresh":"2023-11-01T03:41:18.218105+0000","last_change":"2023-11-01T03:41:18.219153+0000","last_active":"2023-11-01T03:41:18.218105+0000","last_peered":"2023-11-01T03:41:18.218105+0000","last_clean":"2023-11-01T03:41:18.218105+0000","last_became_active":"2023-11-01T03:20:20.189031+0000","last_became_peered":"2023-11-01T03:20:20.189031+0000","last_unstale":"2023-11-01T03:41:18.218105+0000","last_undegraded":"2023-11-01T03:41:18.218105+0000","last_fullsized":"2023-11-01T03:41:18.218105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-01T03:41:18.216784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-01T03:41:18.216784+0000","last_clean_scrub_stamp":"2023-11-01T03:41:18.216784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-02T14:08:07.565854+0000","scrub_duration":0.050787885999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":17,"seq":73014444307,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58664,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313176,"statfs":{"total":96636764160,"available":96576692224,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":11.676,"5min":15.836,"15min":19.196999999999999},"min":{"1min":6.2430000000000003,"5min":4.6719999999999997,"15min":4.6719999999999997},"max":{"1min":20.741,"5min":132.31100000000001,"15min":289.02600000000001},"last":9.1240000000000006},{"interface":"front","average":{"1min":11.744999999999999,"5min":15.736000000000001,"15min":20.332000000000001},"min":{"1min":8.0510000000000002,"5min":6.5060000000000002,"15min":6.04},"max":{"1min":19.341000000000001,"5min":152.499,"15min":234.16399999999999},"last":8.0030000000000001}]},{"osd":1,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.059999999999999,"5min":17.472999999999999,"15min":24.515999999999998},"min":{"1min":7.3689999999999998,"5min":5.5960000000000001,"15min":5.5960000000000001},"max":{"1min":30.327999999999999,"5min":81.850999999999999,"15min":312.29599999999999},"last":6.7080000000000002},{"interface":"front","average":{"1min":14.954000000000001,"5min":18.690999999999999,"15min":22.545000000000002},"min":{"1min":6.9329999999999998,"5min":5.7389999999999999,"15min":5.7389999999999999},"max":{"1min":32.530000000000001,"5min":104.20999999999999,"15min":283.81900000000002},"last":10.863}]},{"osd":3,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":16.760999999999999,"5min":24.260000000000002,"15min":25.206},"min":{"1min":11.019,"5min":8.4700000000000006,"15min":7.5540000000000003},"max":{"1min":26.664999999999999,"5min":137.63900000000001,"15min":244.965},"last":17},{"interface":"front","average":{"1min":12.164,"5min":22.221,"15min":22.803000000000001},"min":{"1min":7.2850000000000001,"5min":6.9089999999999998,"15min":6.3310000000000004},"max":{"1min":25.731999999999999,"5min":179.14099999999999,"15min":294.39800000000002},"last":13.824}]},{"osd":4,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":13.73,"5min":17.324999999999999,"15min":21.829000000000001},"min":{"1min":7.6050000000000004,"5min":7.6050000000000004,"15min":6.5880000000000001},"max":{"1min":32.020000000000003,"5min":74.953999999999994,"15min":263.44},"last":9.9710000000000001},{"interface":"front","average":{"1min":17.609999999999999,"5min":23.350000000000001,"15min":24.706},"min":{"1min":10.638,"5min":9.4610000000000003,"15min":6.6520000000000001},"max":{"1min":34.274999999999999,"5min":136.423,"15min":311.31400000000002},"last":15.115}]},{"osd":5,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":20.611999999999998,"5min":21.478999999999999,"15min":30.905999999999999},"min":{"1min":9.8650000000000002,"5min":8.4550000000000001,"15min":7.9459999999999997},"max":{"1min":55.491999999999997,"5min":106.95099999999999,"15min":445.322},"last":25.683},{"interface":"front","average":{"1min":22.992000000000001,"5min":25.207000000000001,"15min":31.797000000000001},"min":{"1min":9.9879999999999995,"5min":8.8030000000000008,"15min":7.7530000000000001},"max":{"1min":121.22199999999999,"5min":211.19,"15min":449.05500000000001},"last":12.295999999999999}]},{"osd":6,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":15.911,"5min":19.966999999999999,"15min":22.306000000000001},"min":{"1min":8.5960000000000001,"5min":7.5819999999999999,"15min":6.3319999999999999},"max":{"1min":43.619,"5min":127.063,"15min":234.69300000000001},"last":14.146000000000001},{"interface":"front","average":{"1min":24.210000000000001,"5min":24.100000000000001,"15min":27.024999999999999},"min":{"1min":11.393000000000001,"5min":10.782,"15min":9.1590000000000007},"max":{"1min":119.566,"5min":134.08199999999999,"15min":261.47000000000003},"last":17.628}]},{"osd":7,"last update":"Wed Nov 1 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":21.934000000000001,"5min":23.297000000000001,"15min":26.026},"min":{"1min":11.458,"5min":11.391,"15min":9.5679999999999996},"max":{"1min":91.706000000000003,"5min":153.33199999999999,"15min":264.31400000000002},"last":16.353999999999999},{"interface":"front","average":{"1min":20.808,"5min":22.588000000000001,"15min":27.510000000000002},"min":{"1min":12.545999999999999,"5min":10.715,"15min":10.715},"max":{"1min":51.494,"5min":102.056,"15min":301.476},"last":28.454999999999998}]}]},{"osd":1,"up_from":16,"seq":68719477012,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81264,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290576,"statfs":{"total":96636764160,"available":96553549824,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:41:45 2023","interfaces":[{"interface":"back","average":{"1min":10.141999999999999,"5min":14.07,"15min":15.805999999999999},"min":{"1min":7.0620000000000003,"5min":5.0469999999999997,"15min":4.7830000000000004},"max":{"1min":27.974,"5min":202.77600000000001,"15min":232.79599999999999},"last":8.3840000000000003},{"interface":"front","average":{"1min":13.24,"5min":16.876999999999999,"15min":18.021999999999998},"min":{"1min":9.125,"5min":6.8049999999999997,"15min":5.6340000000000003},"max":{"1min":32.902999999999999,"5min":211.577,"15min":211.577},"last":12.925000000000001}]},{"osd":2,"last update":"Wed Nov 1 03:41:48 2023","interfaces":[{"interface":"back","average":{"1min":15.08,"5min":16.643000000000001,"15min":20.995999999999999},"min":{"1min":8.9559999999999995,"5min":6.7930000000000001,"15min":5.2880000000000003},"max":{"1min":50.667000000000002,"5min":157.964,"15min":215.36099999999999},"last":11.628},{"interface":"front","average":{"1min":11.430999999999999,"5min":16.295000000000002,"15min":20.710999999999999},"min":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"max":{"1min":31.352,"5min":94.802999999999997,"15min":230.01499999999999},"last":14.365}]},{"osd":3,"last update":"Wed Nov 1 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":22.356000000000002,"5min":19.739999999999998,"15min":26.463000000000001},"min":{"1min":9.2609999999999992,"5min":8.5410000000000004,"15min":7.1660000000000004},"max":{"1min":139.18199999999999,"5min":139.18199999999999,"15min":301.214},"last":15.714},{"interface":"front","average":{"1min":20.103999999999999,"5min":16.913,"15min":23.349},"min":{"1min":7.2690000000000001,"5min":6.3140000000000001,"15min":5.6449999999999996},"max":{"1min":158.572,"5min":167.44900000000001,"15min":289.25400000000002},"last":7.577}]},{"osd":4,"last update":"Wed Nov 1 03:41:45 2023","interfaces":[{"interface":"back","average":{"1min":18.245000000000001,"5min":18.099,"15min":20.050000000000001},"min":{"1min":10.888999999999999,"5min":6.8310000000000004,"15min":6.8310000000000004},"max":{"1min":54.454999999999998,"5min":92.372,"15min":138.67500000000001},"last":18.608000000000001},{"interface":"front","average":{"1min":15.336,"5min":16.68,"15min":20.260000000000002},"min":{"1min":8.0960000000000001,"5min":6.8810000000000002,"15min":6.7969999999999997},"max":{"1min":51.423000000000002,"5min":82.914000000000001,"15min":265.774},"last":9.4390000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:41:43 2023","interfaces":[{"interface":"back","average":{"1min":17.324999999999999,"5min":19.882999999999999,"15min":23.704000000000001},"min":{"1min":8.2959999999999994,"5min":7.234,"15min":7.234},"max":{"1min":57.234999999999999,"5min":81.769999999999996,"15min":189.726},"last":15.052},{"interface":"front","average":{"1min":19.684999999999999,"5min":20.324000000000002,"15min":22.524000000000001},"min":{"1min":10.496,"5min":7.9809999999999999,"15min":7.9160000000000004},"max":{"1min":79.108999999999995,"5min":102.527,"15min":228.29599999999999},"last":10.598000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:41:43 2023","interfaces":[{"interface":"back","average":{"1min":17.010000000000002,"5min":20.085999999999999,"15min":24.143999999999998},"min":{"1min":11.837999999999999,"5min":9.2620000000000005,"15min":8.3049999999999997},"max":{"1min":32.026000000000003,"5min":88.855999999999995,"15min":144.56100000000001},"last":16.992000000000001},{"interface":"front","average":{"1min":20.867000000000001,"5min":23.036000000000001,"15min":26.555},"min":{"1min":13.272,"5min":13.272,"15min":10.785},"max":{"1min":55.576000000000001,"5min":105.833,"15min":189.06100000000001},"last":16.370999999999999}]},{"osd":7,"last update":"Wed Nov 1 03:41:43 2023","interfaces":[{"interface":"back","average":{"1min":18.111999999999998,"5min":16.733000000000001,"15min":24.521999999999998},"min":{"1min":10.839,"5min":7.5129999999999999,"15min":7.5129999999999999},"max":{"1min":53.231999999999999,"5min":88.796000000000006,"15min":348.608},"last":12.282999999999999},{"interface":"front","average":{"1min":20.027999999999999,"5min":21.855,"15min":28.552},"min":{"1min":13.481999999999999,"5min":12.734999999999999,"15min":11.98},"max":{"1min":56.607999999999997,"5min":89.978999999999999,"15min":345.22899999999998},"last":17.818000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477011,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76712,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295128,"statfs":{"total":96636764160,"available":96558211072,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":73136585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:40:59 2023","interfaces":[{"interface":"back","average":{"1min":22.367000000000001,"5min":21.577999999999999,"15min":22.350999999999999},"min":{"1min":6.5289999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"max":{"1min":89.744,"5min":242.41499999999999,"15min":263.22800000000001},"last":7.8150000000000004},{"interface":"front","average":{"1min":25.785,"5min":24.536000000000001,"15min":22.602},"min":{"1min":7.0380000000000003,"5min":6.3700000000000001,"15min":5.9699999999999998},"max":{"1min":117.911,"5min":268.76499999999999,"15min":296.685},"last":14.666}]},{"osd":1,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":23.143999999999998,"5min":20.587,"15min":26.018999999999998},"min":{"1min":8.3529999999999998,"5min":6.6660000000000004,"15min":5.7220000000000004},"max":{"1min":79.721000000000004,"5min":97.474000000000004,"15min":298.21199999999999},"last":17.629000000000001},{"interface":"front","average":{"1min":26.420999999999999,"5min":22.765999999999998,"15min":25.169},"min":{"1min":8.3089999999999993,"5min":7.2649999999999997,"15min":6.4969999999999999},"max":{"1min":127.789,"5min":188.92400000000001,"15min":380.34100000000001},"last":9.9760000000000009}]},{"osd":2,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":42.904000000000003,"5min":29.129000000000001,"15min":28.062999999999999},"min":{"1min":9.6430000000000007,"5min":6.6139999999999999,"15min":6.6139999999999999},"max":{"1min":228.37100000000001,"5min":228.37100000000001,"15min":333.86399999999998},"last":16.029},{"interface":"front","average":{"1min":39.347000000000001,"5min":28.114999999999998,"15min":29.091999999999999},"min":{"1min":8.3360000000000003,"5min":7.657,"15min":7.3979999999999997},"max":{"1min":229.38300000000001,"5min":229.38300000000001,"15min":286.87599999999998},"last":8.532}]},{"osd":4,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":35.088999999999999,"5min":26.920999999999999,"15min":25.422999999999998},"min":{"1min":7.6440000000000001,"5min":7.6440000000000001,"15min":7.0819999999999999},"max":{"1min":234.393,"5min":234.393,"15min":234.393},"last":16.809999999999999},{"interface":"front","average":{"1min":42.640000000000001,"5min":33.968000000000004,"15min":32.963000000000001},"min":{"1min":11.481,"5min":9.2669999999999995,"15min":9.2669999999999995},"max":{"1min":247.19200000000001,"5min":247.19200000000001,"15min":275.31200000000001},"last":13.855}]},{"osd":5,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":24.603000000000002,"5min":25.818999999999999,"15min":26.486999999999998},"min":{"1min":7.306,"5min":7.165,"15min":6.4980000000000002},"max":{"1min":90.399000000000001,"5min":193.571,"15min":300.15199999999999},"last":25.056999999999999},{"interface":"front","average":{"1min":31.359999999999999,"5min":31.827000000000002,"15min":31.382000000000001},"min":{"1min":10.654,"5min":7.9119999999999999,"15min":7.9119999999999999},"max":{"1min":119.399,"5min":250.13300000000001,"15min":381.19099999999997},"last":22.268000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":27.879999999999999,"5min":27.648,"15min":30.108000000000001},"min":{"1min":8.9420000000000002,"5min":8.9420000000000002,"15min":8.9280000000000008},"max":{"1min":113.8,"5min":227.28999999999999,"15min":301.85899999999998},"last":9.2870000000000008},{"interface":"front","average":{"1min":31.949000000000002,"5min":34.283999999999999,"15min":37.168999999999997},"min":{"1min":11.151999999999999,"5min":10.847,"15min":10.847},"max":{"1min":120.105,"5min":258.98099999999999,"15min":360.77699999999999},"last":12.603}]},{"osd":7,"last update":"Wed Nov 1 03:40:54 2023","interfaces":[{"interface":"back","average":{"1min":32.573,"5min":33.805,"15min":35.795999999999999},"min":{"1min":11.566000000000001,"5min":8.9879999999999995,"15min":8.9879999999999995},"max":{"1min":122.349,"5min":245.68899999999999,"15min":299.50900000000001},"last":11.913},{"interface":"front","average":{"1min":30.728999999999999,"5min":36.881,"15min":40.588999999999999},"min":{"1min":10.978,"5min":10.978,"15min":10.978},"max":{"1min":121.54300000000001,"5min":248.32599999999999,"15min":326.91199999999998},"last":15.359999999999999}]}]},{"osd":0,"up_from":16,"seq":68719477012,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62824,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309016,"statfs":{"total":96636764160,"available":96572432384,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":10.695,"5min":12.73,"15min":18.387},"min":{"1min":6.1970000000000001,"5min":6.1970000000000001,"15min":5.0919999999999996},"max":{"1min":30.196999999999999,"5min":41.195,"15min":193.87200000000001},"last":6.8979999999999997},{"interface":"front","average":{"1min":13.632999999999999,"5min":13.503,"15min":17.638000000000002},"min":{"1min":5.9050000000000002,"5min":5.9050000000000002,"15min":5.9050000000000002},"max":{"1min":36.872,"5min":61.674999999999997,"15min":208.66800000000001},"last":15.285}]},{"osd":2,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":12.663,"5min":16.968,"15min":20.872},"min":{"1min":6.9509999999999996,"5min":6.9509999999999996,"15min":6.657},"max":{"1min":36.070999999999998,"5min":93.488,"15min":224.13399999999999},"last":9.6859999999999999},{"interface":"front","average":{"1min":13.641999999999999,"5min":16.539000000000001,"15min":18.748999999999999},"min":{"1min":9.0229999999999997,"5min":7.1680000000000001,"15min":6.2300000000000004},"max":{"1min":34.320999999999998,"5min":102.666,"15min":223.59999999999999},"last":13.794}]},{"osd":3,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":15.457000000000001,"5min":15.115,"15min":22.445},"min":{"1min":8.7249999999999996,"5min":6.6369999999999996,"15min":6.2480000000000002},"max":{"1min":41.088000000000001,"5min":67.299999999999997,"15min":284.80900000000003},"last":17.722999999999999},{"interface":"front","average":{"1min":18.504000000000001,"5min":21.271000000000001,"15min":23.701000000000001},"min":{"1min":9.9960000000000004,"5min":9.3800000000000008,"15min":6.4130000000000003},"max":{"1min":43.601999999999997,"5min":216.52000000000001,"15min":262.66800000000001},"last":16.170000000000002}]},{"osd":4,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":14.779999999999999,"5min":19.753,"15min":21.510000000000002},"min":{"1min":6.806,"5min":6.806,"15min":6.806},"max":{"1min":53.665999999999997,"5min":206.935,"15min":206.935},"last":10.954000000000001},{"interface":"front","average":{"1min":15.615,"5min":17.678999999999998,"15min":21.597999999999999},"min":{"1min":8.2409999999999997,"5min":6.867,"15min":6.867},"max":{"1min":39.442,"5min":143.786,"15min":224.84399999999999},"last":16.943000000000001}]},{"osd":5,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":15.916,"5min":20.655999999999999,"15min":20.154},"min":{"1min":10.327,"5min":6.7779999999999996,"15min":6.7779999999999996},"max":{"1min":41.701000000000001,"5min":178.88300000000001,"15min":225.07300000000001},"last":14.422000000000001},{"interface":"front","average":{"1min":20.66,"5min":24.463999999999999,"15min":24.27},"min":{"1min":14.567,"5min":11.926,"15min":8.423},"max":{"1min":58.929000000000002,"5min":178.24199999999999,"15min":180.73599999999999},"last":18.957000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":15.154,"5min":19.335999999999999,"15min":24.131},"min":{"1min":9.6140000000000008,"5min":9.218,"15min":8.1940000000000008},"max":{"1min":38.279000000000003,"5min":177.26900000000001,"15min":303.74799999999999},"last":10.323},{"interface":"front","average":{"1min":18.248000000000001,"5min":22.463999999999999,"15min":27.837},"min":{"1min":10.961,"5min":9.4309999999999992,"15min":9.4309999999999992},"max":{"1min":40.219999999999999,"5min":77.754999999999995,"15min":282.93000000000001},"last":11.709}]},{"osd":7,"last update":"Wed Nov 1 03:41:52 2023","interfaces":[{"interface":"back","average":{"1min":18.922999999999998,"5min":23.295999999999999,"15min":24.654},"min":{"1min":11.185,"5min":9.3170000000000002,"15min":8.7509999999999994},"max":{"1min":60.045999999999999,"5min":144.767,"15min":154.27699999999999},"last":12.43},{"interface":"front","average":{"1min":20.335000000000001,"5min":24.196000000000002,"15min":27.771999999999998},"min":{"1min":14.832000000000001,"5min":10.026999999999999,"15min":10.026999999999999},"max":{"1min":42.368000000000002,"5min":148.28200000000001,"15min":226.959},"last":19.863}]}]},{"osd":5,"up_from":15,"seq":64424509717,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77104,"kb_used_data":5672,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294736,"statfs":{"total":96636764160,"available":96557809664,"internally_reserved":0,"allocated":5808128,"data_stored":3255913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":19.959,"5min":15.176,"15min":18.335999999999999},"min":{"1min":4.9119999999999999,"5min":4.444,"15min":4.444},"max":{"1min":108.98699999999999,"5min":108.98699999999999,"15min":231.386},"last":11.981},{"interface":"front","average":{"1min":14.077,"5min":15.837999999999999,"15min":20.797999999999998},"min":{"1min":5.5830000000000002,"5min":4.7149999999999999,"15min":4.5090000000000003},"max":{"1min":49.658000000000001,"5min":111.236,"15min":229.50299999999999},"last":18.387}]},{"osd":1,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":16.622,"5min":21.09,"15min":22.885999999999999},"min":{"1min":6.1580000000000004,"5min":6.0179999999999998,"15min":5.7249999999999996},"max":{"1min":120.39,"5min":302.94099999999997,"15min":328.08199999999999},"last":16.878},{"interface":"front","average":{"1min":23.594999999999999,"5min":27.893999999999998,"15min":30.722000000000001},"min":{"1min":10.057,"5min":8.2050000000000001,"15min":7.6340000000000003},"max":{"1min":124.95399999999999,"5min":322.04599999999999,"15min":328.64800000000002},"last":17.564}]},{"osd":2,"last update":"Wed Nov 1 03:41:48 2023","interfaces":[{"interface":"back","average":{"1min":24.504999999999999,"5min":22.523,"15min":22.888999999999999},"min":{"1min":6.8440000000000003,"5min":6.2510000000000003,"15min":5.8109999999999999},"max":{"1min":100.614,"5min":195.53700000000001,"15min":195.53700000000001},"last":14.539999999999999},{"interface":"front","average":{"1min":23.016999999999999,"5min":22.742999999999999,"15min":22.178000000000001},"min":{"1min":7.9290000000000003,"5min":6.4109999999999996,"15min":6.4109999999999996},"max":{"1min":75.930000000000007,"5min":252.57900000000001,"15min":252.57900000000001},"last":20.640000000000001}]},{"osd":3,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":21.802,"5min":26.018000000000001,"15min":29.34},"min":{"1min":6.9009999999999998,"5min":6.383,"15min":6.383},"max":{"1min":53.186,"5min":226.05600000000001,"15min":726.51099999999997},"last":25.466000000000001},{"interface":"front","average":{"1min":20.355,"5min":27.021000000000001,"15min":30.079999999999998},"min":{"1min":8.6310000000000002,"5min":8.0399999999999991,"15min":6.8179999999999996},"max":{"1min":43.423000000000002,"5min":186.75999999999999,"15min":784.01700000000005},"last":19.181999999999999}]},{"osd":4,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":21.242999999999999,"5min":23.617999999999999,"15min":25.748999999999999},"min":{"1min":7.9669999999999996,"5min":7.2530000000000001,"15min":7.1299999999999999},"max":{"1min":121.00700000000001,"5min":158.505,"15min":327.47699999999998},"last":28.495000000000001},{"interface":"front","average":{"1min":18.486000000000001,"5min":26.175000000000001,"15min":28.079000000000001},"min":{"1min":9.6829999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"max":{"1min":38.863,"5min":205.315,"15min":315.95100000000002},"last":24.16}]},{"osd":6,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":26.513999999999999,"5min":27.212,"15min":27.373000000000001},"min":{"1min":9.5370000000000008,"5min":6.9640000000000004,"15min":6.9640000000000004},"max":{"1min":94.876000000000005,"5min":171.857,"15min":205.63300000000001},"last":21.433},{"interface":"front","average":{"1min":27.893000000000001,"5min":27.288,"15min":29.873999999999999},"min":{"1min":11.782999999999999,"5min":7.9240000000000004,"15min":7.9240000000000004},"max":{"1min":133.702,"5min":182.077,"15min":326.69099999999997},"last":29.379000000000001}]},{"osd":7,"last update":"Wed Nov 1 03:41:41 2023","interfaces":[{"interface":"back","average":{"1min":18.597000000000001,"5min":25.003,"15min":27.199999999999999},"min":{"1min":9.8320000000000007,"5min":8.6859999999999999,"15min":8.5619999999999994},"max":{"1min":42.237000000000002,"5min":170.60599999999999,"15min":215.22399999999999},"last":26.215},{"interface":"front","average":{"1min":19.245999999999999,"5min":23.460000000000001,"15min":26.472999999999999},"min":{"1min":10.707000000000001,"5min":9.6820000000000004,"15min":9.0860000000000003},"max":{"1min":48.853000000000002,"5min":172.72800000000001,"15min":290.32499999999999},"last":24.805}]}]},{"osd":7,"up_from":14,"seq":60129542421,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":9.7560000000000002,"5min":18.619,"15min":20.097000000000001},"min":{"1min":6.5499999999999998,"5min":4.6550000000000002,"15min":4.468},"max":{"1min":14.031000000000001,"5min":205.869,"15min":205.869},"last":11.157999999999999},{"interface":"front","average":{"1min":13.590999999999999,"5min":23.206,"15min":24.065999999999999},"min":{"1min":9.1080000000000005,"5min":8.1890000000000001,"15min":5.7560000000000002},"max":{"1min":18.387,"5min":248.73099999999999,"15min":248.73099999999999},"last":11.836}]},{"osd":1,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":9.5120000000000005,"5min":14.007,"15min":21.41},"min":{"1min":6.1639999999999997,"5min":4.7000000000000002,"15min":4.7000000000000002},"max":{"1min":33.113,"5min":115.364,"15min":272.86900000000003},"last":10.324999999999999},{"interface":"front","average":{"1min":17.02,"5min":23.329999999999998,"15min":26.710999999999999},"min":{"1min":9.7319999999999993,"5min":7.9589999999999996,"15min":5.6390000000000002},"max":{"1min":72.748000000000005,"5min":267.911,"15min":296.34100000000001},"last":12.542999999999999}]},{"osd":2,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":17.981999999999999,"5min":20.422999999999998,"15min":23.437999999999999},"min":{"1min":10.182,"5min":8.8209999999999997,"15min":5.9279999999999999},"max":{"1min":73.686000000000007,"5min":101.59699999999999,"15min":167.721},"last":13.198},{"interface":"front","average":{"1min":13.842000000000001,"5min":16.965,"15min":19.908999999999999},"min":{"1min":7.3390000000000004,"5min":6.5170000000000003,"15min":5.9950000000000001},"max":{"1min":78.010000000000005,"5min":109.086,"15min":251.75899999999999},"last":16.227}]},{"osd":3,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":20.888999999999999,"5min":25.605,"15min":26.640000000000001},"min":{"1min":9.7240000000000002,"5min":6.7000000000000002,"15min":5.8979999999999997},"max":{"1min":155.245,"5min":207.48699999999999,"15min":864.23099999999999},"last":19.225999999999999},{"interface":"front","average":{"1min":16.411999999999999,"5min":22.629999999999999,"15min":19.978999999999999},"min":{"1min":6.1260000000000003,"5min":5.8739999999999997,"15min":5.4370000000000003},"max":{"1min":161.16200000000001,"5min":167.27799999999999,"15min":210.626},"last":7.0309999999999997}]},{"osd":4,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":21.995000000000001,"5min":23.440999999999999,"15min":24.433},"min":{"1min":10.916,"5min":7.6989999999999998,"15min":7.6989999999999998},"max":{"1min":86.909000000000006,"5min":104.51000000000001,"15min":168.39099999999999},"last":13.858000000000001},{"interface":"front","average":{"1min":32.188000000000002,"5min":22.963999999999999,"15min":21.948},"min":{"1min":8.1820000000000004,"5min":8.1010000000000009,"15min":7.3730000000000002},"max":{"1min":266.03500000000003,"5min":266.03500000000003,"15min":266.03500000000003},"last":18.385000000000002}]},{"osd":5,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":31.215,"5min":26.623000000000001,"15min":22.716999999999999},"min":{"1min":13.484999999999999,"5min":11.766999999999999,"15min":6.2320000000000002},"max":{"1min":166.316,"5min":166.316,"15min":196.05000000000001},"last":15.553000000000001},{"interface":"front","average":{"1min":31.545000000000002,"5min":24.776,"15min":25.148},"min":{"1min":8.2469999999999999,"5min":7.3049999999999997,"15min":7.3049999999999997},"max":{"1min":207.17400000000001,"5min":207.17400000000001,"15min":233.071},"last":20.204000000000001}]},{"osd":6,"last update":"Wed Nov 1 03:41:47 2023","interfaces":[{"interface":"back","average":{"1min":11.343999999999999,"5min":15.401999999999999,"15min":18.513999999999999},"min":{"1min":6.7329999999999997,"5min":6.5,"15min":5.9080000000000004},"max":{"1min":28.861999999999998,"5min":153.58699999999999,"15min":194.02000000000001},"last":8.3420000000000005},{"interface":"front","average":{"1min":17.190999999999999,"5min":23.795999999999999,"15min":27.696999999999999},"min":{"1min":12.003,"5min":9.0470000000000006,"15min":9.0370000000000008},"max":{"1min":20.597000000000001,"5min":149.88499999999999,"15min":187.38900000000001},"last":17.297999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575126,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80872,"kb_used_data":5280,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290968,"statfs":{"total":96636764160,"available":96553951232,"internally_reserved":0,"allocated":5406720,"data_stored":2858073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:41:42 2023","interfaces":[{"interface":"back","average":{"1min":10.715999999999999,"5min":17.346,"15min":16.584},"min":{"1min":4.46,"5min":4.46,"15min":4.431},"max":{"1min":25.669,"5min":182.16200000000001,"15min":215.01400000000001},"last":15.706},{"interface":"front","average":{"1min":10.951000000000001,"5min":17.763000000000002,"15min":17.300000000000001},"min":{"1min":4.4390000000000001,"5min":4.2370000000000001,"15min":4.2370000000000001},"max":{"1min":22.513000000000002,"5min":165.08500000000001,"15min":208.00800000000001},"last":9.6199999999999992}]},{"osd":1,"last update":"Wed Nov 1 03:41:42 2023","interfaces":[{"interface":"back","average":{"1min":17.167999999999999,"5min":26.204999999999998,"15min":22.567},"min":{"1min":6.4020000000000001,"5min":5.6749999999999998,"15min":5.6749999999999998},"max":{"1min":104.733,"5min":508.113,"15min":508.113},"last":8.8320000000000007},{"interface":"front","average":{"1min":16.916,"5min":21.218,"15min":19.132999999999999},"min":{"1min":6.7789999999999999,"5min":6.5369999999999999,"15min":5.1879999999999997},"max":{"1min":78.427999999999997,"5min":183.512,"15min":183.512},"last":7.6500000000000004}]},{"osd":2,"last update":"Wed Nov 1 03:41:50 2023","interfaces":[{"interface":"back","average":{"1min":19.536000000000001,"5min":25.696000000000002,"15min":22.129000000000001},"min":{"1min":7.7510000000000003,"5min":6.9059999999999997,"15min":6.5380000000000003},"max":{"1min":122.467,"5min":276.858,"15min":276.858},"last":11.294},{"interface":"front","average":{"1min":22.521999999999998,"5min":30.907,"15min":24.600999999999999},"min":{"1min":8.2379999999999995,"5min":6.7480000000000002,"15min":5.944},"max":{"1min":149.95599999999999,"5min":252.52099999999999,"15min":252.52099999999999},"last":14.962999999999999}]},{"osd":3,"last update":"Wed Nov 1 03:41:42 2023","interfaces":[{"interface":"back","average":{"1min":16.370999999999999,"5min":21.140000000000001,"15min":24.722999999999999},"min":{"1min":8.8919999999999995,"5min":6.7930000000000001,"15min":6.7869999999999999},"max":{"1min":35.979999999999997,"5min":77.144000000000005,"15min":327.39800000000002},"last":12.747999999999999},{"interface":"front","average":{"1min":19.344000000000001,"5min":26.995000000000001,"15min":28.234000000000002},"min":{"1min":8.1799999999999997,"5min":7.6429999999999998,"15min":6.8659999999999997},"max":{"1min":81.981999999999999,"5min":178.98500000000001,"15min":768.45699999999999},"last":10.574}]},{"osd":4,"last update":"Wed Nov 1 03:41:37 2023","interfaces":[{"interface":"back","average":{"1min":22.143999999999998,"5min":20.579000000000001,"15min":19.472999999999999},"min":{"1min":7.7560000000000002,"5min":6.5469999999999997,"15min":6.4359999999999999},"max":{"1min":203.41800000000001,"5min":203.41800000000001,"15min":303.637},"last":12.01},{"interface":"front","average":{"1min":28.233000000000001,"5min":26.748999999999999,"15min":24.806000000000001},"min":{"1min":11.935,"5min":9.1750000000000007,"15min":8.75},"max":{"1min":245.54900000000001,"5min":245.54900000000001,"15min":304.79700000000003},"last":17.228000000000002}]},{"osd":5,"last update":"Wed Nov 1 03:41:42 2023","interfaces":[{"interface":"back","average":{"1min":23.945,"5min":25.012,"15min":22.050999999999998},"min":{"1min":9.7469999999999999,"5min":7.6859999999999999,"15min":6.407},"max":{"1min":141.50200000000001,"5min":141.50200000000001,"15min":143.779},"last":19.581},{"interface":"front","average":{"1min":26.526,"5min":33.570999999999998,"15min":26.960999999999999},"min":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"max":{"1min":204.56800000000001,"5min":530.04300000000001,"15min":530.04300000000001},"last":16.439}]},{"osd":7,"last update":"Wed Nov 1 03:41:42 2023","interfaces":[{"interface":"back","average":{"1min":16.798999999999999,"5min":30.890999999999998,"15min":25.277000000000001},"min":{"1min":8.7539999999999996,"5min":8.7539999999999996,"15min":7.4710000000000001},"max":{"1min":30.297000000000001,"5min":319.23700000000002,"15min":319.23700000000002},"last":18.035},{"interface":"front","average":{"1min":17.303000000000001,"5min":27.763999999999999,"15min":24.202999999999999},"min":{"1min":10.666,"5min":9.2729999999999997,"15min":7.1109999999999998},"max":{"1min":26.905000000000001,"5min":193.06299999999999,"15min":193.06299999999999},"last":13.532999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575126,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":5410816,"data_stored":2858078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 1 03:41:55 2023","interfaces":[{"interface":"back","average":{"1min":10.951000000000001,"5min":14.275,"15min":15.997999999999999},"min":{"1min":5.5499999999999998,"5min":4.7469999999999999,"15min":4.1219999999999999},"max":{"1min":18.940000000000001,"5min":101.489,"15min":203.45400000000001},"last":12.156000000000001},{"interface":"front","average":{"1min":10.204000000000001,"5min":11.951000000000001,"15min":13.753},"min":{"1min":6.3479999999999999,"5min":5.3470000000000004,"15min":4.7670000000000003},"max":{"1min":17.654,"5min":111.852,"15min":141.04300000000001},"last":8.7680000000000007}]},{"osd":1,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":17.376000000000001,"5min":17.553999999999998,"15min":19.548999999999999},"min":{"1min":6.5350000000000001,"5min":6.3730000000000002,"15min":5.7309999999999999},"max":{"1min":97.834999999999994,"5min":231.58799999999999,"15min":237.00800000000001},"last":14.055999999999999},{"interface":"front","average":{"1min":12.862,"5min":15.491,"15min":21.228999999999999},"min":{"1min":7.0250000000000004,"5min":5.468,"15min":5.468},"max":{"1min":45.398000000000003,"5min":160.93700000000001,"15min":237.965},"last":19.587}]},{"osd":2,"last update":"Wed Nov 1 03:41:55 2023","interfaces":[{"interface":"back","average":{"1min":13.494999999999999,"5min":17.268999999999998,"15min":20.062000000000001},"min":{"1min":8.7880000000000003,"5min":7.3719999999999999,"15min":6.1890000000000001},"max":{"1min":20.327000000000002,"5min":189.38200000000001,"15min":269.88600000000002},"last":18.532},{"interface":"front","average":{"1min":13.116,"5min":18.937999999999999,"15min":20.593},"min":{"1min":8.1560000000000006,"5min":6.4320000000000004,"15min":6.4320000000000004},"max":{"1min":18.492000000000001,"5min":260.46800000000002,"15min":260.46800000000002},"last":11.487}]},{"osd":3,"last update":"Wed Nov 1 03:41:55 2023","interfaces":[{"interface":"back","average":{"1min":13.630000000000001,"5min":17.187000000000001,"15min":21.541},"min":{"1min":10.069000000000001,"5min":6.2530000000000001,"15min":6.2530000000000001},"max":{"1min":20.475000000000001,"5min":165.47200000000001,"15min":275.15199999999999},"last":20.475000000000001},{"interface":"front","average":{"1min":13.77,"5min":19.327999999999999,"15min":23.512},"min":{"1min":7.4800000000000004,"5min":7.4800000000000004,"15min":7.1429999999999998},"max":{"1min":18.859000000000002,"5min":140.23099999999999,"15min":505.59199999999998},"last":14.846}]},{"osd":5,"last update":"Wed Nov 1 03:41:55 2023","interfaces":[{"interface":"back","average":{"1min":14.122999999999999,"5min":18.407,"15min":23.599},"min":{"1min":11.101000000000001,"5min":7.5830000000000002,"15min":6.6900000000000004},"max":{"1min":19.914000000000001,"5min":129.33199999999999,"15min":239.59299999999999},"last":11.101000000000001},{"interface":"front","average":{"1min":14.417999999999999,"5min":21.076000000000001,"15min":24.620000000000001},"min":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"max":{"1min":18.445,"5min":133.33000000000001,"15min":272.53399999999999},"last":12.965}]},{"osd":6,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":19.975000000000001,"5min":22.268000000000001,"15min":22.529},"min":{"1min":9.3900000000000006,"5min":7.2060000000000004,"15min":7.2060000000000004},"max":{"1min":79.174999999999997,"5min":350.44400000000002,"15min":350.44400000000002},"last":13.345000000000001},{"interface":"front","average":{"1min":24.341999999999999,"5min":26.786000000000001,"15min":28.228000000000002},"min":{"1min":14.526,"5min":9.9550000000000001,"15min":9.8650000000000002},"max":{"1min":100.511,"5min":351.82100000000003,"15min":351.82100000000003},"last":15.606}]},{"osd":7,"last update":"Wed Nov 1 03:41:29 2023","interfaces":[{"interface":"back","average":{"1min":14.221,"5min":17.978999999999999,"15min":22.213000000000001},"min":{"1min":8.8599999999999994,"5min":7.399,"15min":7.399},"max":{"1min":27.715,"5min":138.69900000000001,"15min":240.44200000000001},"last":7.7279999999999998},{"interface":"front","average":{"1min":27.120999999999999,"5min":22.834,"15min":25.417999999999999},"min":{"1min":13.260999999999999,"5min":9.907,"15min":8.4299999999999997},"max":{"1min":101.629,"5min":122.86199999999999,"15min":256.74900000000002},"last":16.265999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-01T03:41:59.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-01T03:41:59.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.384+0000 7f8dc20b4640 10 monclient: get_monmap_and_config 2023-11-01T03:41:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.384+0000 7f8dc20b4640 10 monclient: build_initial_monmap 2023-11-01T03:41:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.384+0000 7f8dc20b4640 10 monclient: monmap: 2023-11-01T03:41:59.385 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:41:59.385342+0000 2023-11-01T03:41:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:41:59.385342+0000 2023-11-01T03:41:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.387 INFO:teuthology.orchestra.run.smithi005.stderr:0: v1:172.21.15.5:6789/0 mon.noname-a-legacy 2023-11-01T03:41:59.387 INFO:teuthology.orchestra.run.smithi005.stderr:1: v1:172.21.15.153:6789/0 mon.noname-c-legacy 2023-11-01T03:41:59.387 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-b 2023-11-01T03:41:59.387 INFO:teuthology.orchestra.run.smithi005.stderr:3: v2:172.21.15.5:3300/0 mon.noname-a 2023-11-01T03:41:59.387 INFO:teuthology.orchestra.run.smithi005.stderr:4: v2:172.21.15.153:3300/0 mon.noname-c 2023-11-01T03:41:59.388 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 Processor -- start 2023-11-01T03:41:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 -- start start 2023-11-01T03:41:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient: init 2023-11-01T03:41:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dbc065d60 0x7f8dbc0acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-a con 0x7f8dbc065d60 addr v2:172.21.15.5:3300/0 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8dbc070f70 0x7f8dbc13f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-c con 0x7f8dbc070f70 addr v2:172.21.15.153:3300/0 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8dbc0ad4c0 addr v1:172.21.15.153:6789/0 2023-11-01T03:41:59.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc06e6d0 con 0x7f8dbc0ad4c0 2023-11-01T03:41:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc136600 con 0x7f8dbc065d60 2023-11-01T03:41:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc066140 con 0x7f8dbc070f70 2023-11-01T03:41:59.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.385+0000 7f8dc20b4640 10 monclient(hunting): authenticate will time out at 2795.609890s 2023-11-01T03:41:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dbc065d60 0x7f8dbc0acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8dbc065d60 0x7f8dbc0acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50592/0 (socket says 172.21.15.5:50592) 2023-11-01T03:41:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 1 -- 172.21.15.5:0/1307777094 learned_addr learned my addr 172.21.15.5:0/1307777094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:59.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 10 monclient(hunting): get_auth_request con 0x7f8dbc065d60 auth_method 0 2023-11-01T03:41:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.386+0000 7f8dbaffd640 1 --2- 172.21.15.5:0/1307777094 >> v2:172.21.15.153:3300/0 conn(0x7f8dbc070f70 0x7f8dbc13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): get_auth_request con 0x7f8dbc070f70 auth_method 0 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.387+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_done global_id 15513 payload 274 2023-11-01T03:41:59.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 1 -- 172.21.15.5:0/1307777094 >> v2:172.21.15.153:3300/0 conn(0x7f8dbc070f70 msgr2=0x7f8dbc13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 1 --2- 172.21.15.5:0/1307777094 >> v2:172.21.15.153:3300/0 conn(0x7f8dbc070f70 0x7f8dbc13f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 1 -- 172.21.15.5:0/1307777094 >> v1:172.21.15.153:6789/0 conn(0x7f8dbc0ad4c0 legacy=0x7f8dbc13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 10 monclient: _finish_hunting 0 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 1 monclient: found mon.noname-a 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.5:3300/0 2023-11-01T03:41:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.389+0000 7f8dbb7fe640 1 -- 172.21.15.5:0/1307777094 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc06e240 con 0x7f8dbc065d60 2023-11-01T03:41:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.391+0000 7f8dbb7fe640 1 --2- 172.21.15.5:0/1307777094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc0acf80 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc140780 tx=0x7f8dac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db48dad2ab0cab6a server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 1 -- 172.21.15.5:0/1307777094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0317e0 con 0x7f8dbc065d60 2023-11-01T03:41:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-01T03:41:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: dump: 2023-11-01T03:41:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:59.403 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: _finish_auth 0 2023-11-01T03:41:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: _check_auth_tickets 2023-11-01T03:41:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 1 -- 172.21.15.5:0/1307777094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac031940 con 0x7f8dbc065d60 2023-11-01T03:41:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dc20b4640 5 monclient: authenticate success, global_id 15513 2023-11-01T03:41:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dc20b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dc20b4640 10 monclient: get_monmap_and_config success 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dc20b4640 4 set_mon_vals no callback set 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 1 -- 172.21.15.5:0/1307777094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac031cd0 con 0x7f8dbc065d60 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-01T03:41:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.394+0000 7f8dba7fc640 10 monclient: dump: 2023-11-01T03:41:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 10 monclient: shutdown 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 -- 172.21.15.5:0/1307777094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 msgr2=0x7f8dbc0acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/1307777094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc0acf80 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc140780 tx=0x7f8dac02b880 comp rx=0 tx=0).stop 2023-11-01T03:41:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 -- 172.21.15.5:0/1307777094 shutdown_connections 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/1307777094 >> v2:172.21.15.153:3300/0 conn(0x7f8dbc070f70 0x7f8dbc13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/1307777094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc0acf80 unknown :-1 s=CLOSED pgs=3014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 -- 172.21.15.5:0/1307777094 >> 172.21.15.5:0/1307777094 conn(0x7f8dbc0b3c90 msgr2=0x7f8dbc0b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 -- 172.21.15.5:0/1307777094 shutdown_connections 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.395+0000 7f8dc20b4640 1 -- 172.21.15.5:0/1307777094 wait complete. 2023-11-01T03:41:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 10 monclient: build_initial_monmap 2023-11-01T03:41:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 10 monclient: monmap: 2023-11-01T03:41:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 0 2023-11-01T03:41:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-01T03:41:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 0.000000 2023-11-01T03:41:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:created 0.000000 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 0 (unknown) 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.noname-a 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.noname-c 2023-11-01T03:41:59.413 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 librados: starting msgr at 2023-11-01T03:41:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 librados: starting objecter 2023-11-01T03:41:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 Processor -- start 2023-11-01T03:41:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 -- start start 2023-11-01T03:41:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 librados: setting wanted keys 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 1 librados: calling monclient init 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.396+0000 7f8dc20b4640 10 monclient: init 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient: _reopen_session rank -1 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc1346f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-a con 0x7f8dbc065d60 addr [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 0x7f8dbc13c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-c con 0x7f8dbc0ad4c0 addr [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 0x7f8dbc13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): picked mon.noname-b con 0x7f8dbc06f110 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc13cd70 con 0x7f8dbc065d60 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc06fad0 con 0x7f8dbc06f110 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): start opening mon connection 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 1 -- --> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc06ee80 con 0x7f8dbc0ad4c0 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): _renew_subs 2023-11-01T03:41:59.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dc20b4640 10 monclient(hunting): authenticate will time out at 2795.621319s 2023-11-01T03:41:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dbaffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 0x7f8dbc13c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc1346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.397+0000 7f8dbbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 0x7f8dbc13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 1 --2- >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 0x7f8dbc13c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3301/0 says I am v2:172.21.15.5:49350/0 (socket says 172.21.15.5:49350) 2023-11-01T03:41:59.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 1 -- 172.21.15.5:0/4064498814 learned_addr learned my addr 172.21.15.5:0/4064498814 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): get_auth_request con 0x7f8dbc0ad4c0 auth_method 0 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): get_auth_request con 0x7f8dbc065d60 auth_method 0 2023-11-01T03:41:59.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): get_auth_request con 0x7f8dbc06f110 auth_method 0 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): _init_auth method 2 2023-11-01T03:41:59.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:59.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-01T03:41:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-01T03:41:59.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.398+0000 7f8dbaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-01T03:41:59.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 10 monclient(hunting): handle_auth_done global_id 22267 payload 824 2023-11-01T03:41:59.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 -- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 msgr2=0x7f8dbc13c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 0x7f8dbc13c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 -- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 msgr2=0x7f8dbc1346f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:41:59.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc1346f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:41:59.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 10 monclient: _finish_hunting 0 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 monclient: found mon.noname-b 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.153:3300/0 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.401+0000 7f8dbbfff640 1 -- 172.21.15.5:0/4064498814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0094d0 con 0x7f8dbc06f110 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.403+0000 7f8dbbfff640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 0x7f8dbc13c830 secure :-1 s=READY pgs=5575 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ad8c0 tx=0x7f8db400cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.403+0000 7f8da3fff640 10 client.?.objecter ms_handle_connect 0x7f8dbc06f110 2023-11-01T03:41:59.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.403+0000 7f8da3fff640 10 client.?.objecter resend_mon_ops 2023-11-01T03:41:59.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4003b70 con 0x7f8dbc06f110 2023-11-01T03:41:59.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:59.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-01T03:41:59.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: dump: 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: _finish_auth 0 2023-11-01T03:41:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: _check_auth_tickets 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4003cd0 con 0x7f8dbc06f110 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 5 monclient: authenticate success, global_id 22267 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: handle_config config(0 keys) v1 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4005310 con 0x7f8dbc06f110 2023-11-01T03:41:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 10 monclient: _renew_subs 2023-11-01T03:41:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc135340 con 0x7f8dbc06f110 2023-11-01T03:41:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-01T03:41:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8db97fa640 4 set_mon_vals no callback set 2023-11-01T03:41:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8da3fff640 10 monclient: dump: 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:epoch 1 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:fsid 7577fdb6-f4bf-4fa5-bdea-9d20c8455b32 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:last_changed 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:created 2023-11-01T03:17:27.405637+0000 2023-11-01T03:41:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:min_mon_release 18 (reef) 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:election_strategy: 1 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:41:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 10 client.22267.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-01T03:41:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 10 monclient: _renew_subs 2023-11-01T03:41:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc06f840 con 0x7f8dbc06f110 2023-11-01T03:41:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.407+0000 7f8dc20b4640 1 librados: init done 2023-11-01T03:41:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.408+0000 7f8dc20b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.408+0000 7f8dc20b4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.408+0000 7f8dc20b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.408+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc04e9f0 con 0x7f8dbc06f110 2023-11-01T03:41:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.648+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8db4005470 con 0x7f8dbc06f110 2023-11-01T03:41:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.649+0000 7f8da3fff640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 0x7f8da806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-01T03:41:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.649+0000 7f8dbb7fe640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 0x7f8da806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-01T03:41:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.649+0000 7f8dbb7fe640 10 monclient: get_auth_request con 0x7f8da806c880 auth_method 0 2023-11-01T03:41:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.649+0000 7f8dbb7fe640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 0x7f8da806ed40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8dac036000 tx=0x7f8dac03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-01T03:41:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.649+0000 7f8da3fff640 10 client.22267.objecter ms_handle_connect 0x7f8da806c880 2023-11-01T03:41:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.663+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(902..902 src has 593..902) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8db4058920 con 0x7f8dbc06f110 2023-11-01T03:41:59.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.663+0000 7f8da3fff640 10 client.22267.objecter ms_dispatch 0x7f8dbc000b90 osd_map(902..902 src has 593..902) v4 2023-11-01T03:41:59.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.663+0000 7f8da3fff640 3 client.22267.objecter handle_osd_map got epochs [902,902] > 0 2023-11-01T03:41:59.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.663+0000 7f8da3fff640 3 client.22267.objecter handle_osd_map decoding full epoch 902 2023-11-01T03:41:59.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.663+0000 7f8da3fff640 20 client.22267.objecter dump_active .. 0 homeless 2023-11-01T03:41:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.673+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8db4054c60 con 0x7f8dbc06f110 2023-11-01T03:41:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.673+0000 7f8da3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-01T03:41:59.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.673+0000 7f8da3fff640 10 monclient: _finish_command 1 = system:0 2023-11-01T03:41:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.860+0000 7f8dc20b4640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-01T03:41:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.860+0000 7f8dc20b4640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-01T03:41:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.860+0000 7f8dc20b4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.153:3300/0 2023-11-01T03:41:59.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:41:59.860+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8dbc06e6b0 con 0x7f8dbc06f110 2023-11-01T03:42:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8db40b4ca0 con 0x7f8dbc06f110 2023-11-01T03:42:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8da3fff640 10 monclient: handle_config config(1 keys) v1 2023-11-01T03:42:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8db97fa640 4 set_mon_vals no callback set 2023-11-01T03:42:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8db97fa640 10 set_mon_vals mon_health_to_clog = false 2023-11-01T03:42:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8da3fff640 1 -- 172.21.15.5:0/4064498814 <== mon.1 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8db4058280 con 0x7f8dbc06f110 2023-11-01T03:42:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8da3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-01T03:42:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.061+0000 7f8da3fff640 10 monclient: _finish_command 2 = system:0 2023-11-01T03:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.063+0000 7f8dc20b4640 10 librados: watch_flush enter 2023-11-01T03:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 10 librados: watch_flush exit 2023-11-01T03:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 20 client.22267.objecter shutdown clearing up homeless session... 2023-11-01T03:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 10 client.22267.objecter successfully canceled tick 2023-11-01T03:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 msgr2=0x7f8da806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:42:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 0x7f8da806ed40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8dac036000 tx=0x7f8dac03d040 comp rx=0 tx=0).stop 2023-11-01T03:42:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 10 monclient: shutdown 2023-11-01T03:42:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-01T03:42:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 msgr2=0x7f8dbc13c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-01T03:42:00.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 0x7f8dbc13c830 secure :-1 s=READY pgs=5575 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ad8c0 tx=0x7f8db400cb20 comp rx=0 tx=0).stop 2023-11-01T03:42:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 shutdown_connections 2023-11-01T03:42:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:6800/1571677761,v1:172.21.15.5:6801/1571677761] conn(0x7f8da806c880 0x7f8da806ed40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:42:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dbc06f110 0x7f8dbc13c830 unknown :-1 s=CLOSED pgs=5575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:42:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7f8dbc0ad4c0 0x7f8dbc13c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:42:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 --2- 172.21.15.5:0/4064498814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8dbc065d60 0x7f8dbc1346f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-01T03:42:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 >> 172.21.15.5:0/4064498814 conn(0x7f8dbc0b3c90 msgr2=0x7f8dbc0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-01T03:42:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 shutdown_connections 2023-11-01T03:42:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 -- 172.21.15.5:0/4064498814 wait complete. 2023-11-01T03:42:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-11-01T03:42:00.064+0000 7f8dc20b4640 1 librados: shutdown 2023-11-01T03:42:00.079 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-01T03:42:00.079 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-01T03:42:00.080 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-01T03:42:00.080 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:42:00.093 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:42:00.084+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 86406) UID: 0 2023-11-01T03:42:00.096 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-11-01T03:42:00.085+0000 b47e640 -1 osd.0 902 *** Got signal Terminated *** 2023-11-01T03:42:08.131 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:09.441 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.181 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:09.491 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.197 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:09.507 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.226 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:09.497 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.227 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:09.498 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.242 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:09.513 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.263 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:09.573 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.265 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:09.575 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:08.286 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:09.596 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.284 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:19.555 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.285 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:19.595 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.289 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:19.561 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.295 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:19.605 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.308 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:19.580 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.319 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:19.629 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.345 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:19.655 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.349 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:19.659 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:18.363 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:19.672 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.519 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:21.829 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.522 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:21.832 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.536 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:21.846 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.573 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:21.844 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.574 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:21.846 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.576 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:21.886 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.578 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:21.888 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.587 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:21.859 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:20.592 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:21.902 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:24.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-01T03:42:24.486 INFO:tasks.ceph.osd.0:Stopped 2023-11-01T03:42:24.487 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-01T03:42:24.487 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:42:24.500 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:42:24.490+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 86415) UID: 0 2023-11-01T03:42:24.500 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-11-01T03:42:24.492+0000 b47e640 -1 osd.1 910 *** Got signal Terminated *** 2023-11-01T03:42:30.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-01T03:42:30.589 INFO:tasks.ceph.osd.1:Stopped 2023-11-01T03:42:30.589 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-01T03:42:30.590 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:42:30.603 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:42:30.593+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 86423) UID: 0 2023-11-01T03:42:30.603 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-11-01T03:42:30.595+0000 b47e640 -1 osd.2 914 *** Got signal Terminated *** 2023-11-01T03:42:33.230 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:34.540 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.233 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:34.543 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.251 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:34.561 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.277 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:34.586 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.281 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:34.591 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.283 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:34.555 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.284 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:34.556 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.301 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:34.611 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.302 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:34.574 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.871 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:35.142 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.872 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:35.144 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.880 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:35.152 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.925 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:35.235 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.926 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:35.236 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.934 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:35.244 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.948 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:35.258 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.949 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:35.259 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:33.957 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:35.267 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:36.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-01T03:42:36.692 INFO:tasks.ceph.osd.2:Stopped 2023-11-01T03:42:36.693 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-01T03:42:36.693 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:42:36.706 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:42:36.697+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 86439) UID: 0 2023-11-01T03:42:36.706 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-11-01T03:42:36.698+0000 b47e640 -1 osd.3 916 *** Got signal Terminated *** 2023-11-01T03:42:42.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-01T03:42:53.297 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:54.607 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.302 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:54.612 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.323 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:54.633 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.351 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:54.622 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.351 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:54.661 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.353 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:54.663 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.355 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:54.626 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.374 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:54.645 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.375 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:54.685 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.948 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:55.219 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.949 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:55.220 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:53.956 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:55.228 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.050 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:55.360 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.051 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:55.361 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.063 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:24:55.372 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.076 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:55.386 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.077 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:55.387 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:42:54.090 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:24:55.399 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:01.098 INFO:tasks.ceph.osd.3:Stopped 2023-11-01T03:43:01.099 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-01T03:43:01.100 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:43:01.113 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:43:01.103+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 86045) UID: 0 2023-11-01T03:43:01.116 INFO:tasks.ceph.osd.4.smithi153.stderr:2023-11-01T03:43:01.105+0000 b47e640 -1 osd.4 920 *** Got signal Terminated *** 2023-11-01T03:43:06.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-01T03:43:07.202 INFO:tasks.ceph.osd.4:Stopped 2023-11-01T03:43:07.202 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-01T03:43:07.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:43:07.216 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:43:07.206+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 86048) UID: 0 2023-11-01T03:43:07.216 INFO:tasks.ceph.osd.5.smithi153.stderr:2023-11-01T03:43:07.208+0000 b47e640 -1 osd.5 923 *** Got signal Terminated *** 2023-11-01T03:43:08.290 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:09.600 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.341 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:09.651 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.359 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:09.669 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.388 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:09.660 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.390 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:09.662 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.390 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:09.701 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.393 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:09.703 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.408 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:09.680 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:08.415 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:09.725 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:12.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-01T03:43:13.362 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:14.672 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.364 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:14.674 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.376 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:14.686 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.408 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:14.679 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.411 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:14.682 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.411 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:14.721 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.413 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:14.723 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.425 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:14.735 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:13.427 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:14.699 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.417 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:24.727 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.446 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:24.756 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.461 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:24.771 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.462 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:24.733 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.465 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:24.736 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.470 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:24.780 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.471 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:24.781 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.505 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:24.777 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:23.515 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:24.825 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.416 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:34.726 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.419 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:34.729 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.437 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:34.747 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.466 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:34.737 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.468 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:34.740 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.472 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:34.782 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.474 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:34.784 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.482 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:34.754 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:33.488 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:34.798 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.397 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:44.707 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.450 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:44.760 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.465 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:44.775 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.497 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:44.769 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.500 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:44.771 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.502 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:44.812 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.506 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:44.815 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.512 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:44.784 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:43.519 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:44.829 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.476 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:54.786 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.479 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:54.789 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.495 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:25:54.805 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.526 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:54.798 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.528 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:54.800 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.529 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:54.839 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.532 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:54.842 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.541 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:54.812 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:43:53.545 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:25:54.855 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.511 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:04.820 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.512 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:04.822 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.526 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:04.836 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.556 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:04.828 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.558 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:04.830 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.564 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:04.874 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.567 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:04.877 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.570 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:04.842 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:03.579 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:04.889 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.538 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:14.847 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.540 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:14.850 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.558 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:14.868 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.587 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:14.859 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.590 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:14.862 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.591 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:14.901 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.595 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:14.905 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.602 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:14.873 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:13.611 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:14.921 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.573 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:24.883 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.575 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:24.885 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.589 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:24.899 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.616 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:24.887 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.619 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:24.890 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.631 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:24.902 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.643 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:24.953 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.646 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:24.956 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:23.663 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:24.973 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.605 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:34.915 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.607 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:34.917 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.621 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:34.931 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.654 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:34.926 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.656 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:34.928 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.661 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:34.971 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.662 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:34.972 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.667 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:34.939 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:33.674 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:34.984 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.606 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:44.916 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.653 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:44.924 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.654 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:44.926 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.660 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:44.970 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.667 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:44.939 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.679 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:44.989 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.711 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:45.020 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.714 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:45.024 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:43.728 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:45.038 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.674 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:54.984 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.676 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:54.986 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.692 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:26:55.002 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.720 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:54.992 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.723 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:54.995 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.725 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:55.035 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.729 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:55.039 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.735 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:26:55.007 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:44:53.743 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:26:55.053 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.709 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:05.019 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.710 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:05.020 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.726 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:05.036 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.756 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:05.028 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.759 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:05.031 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.760 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:05.070 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.763 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:05.073 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.772 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:05.043 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:03.776 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:05.086 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.789 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.099 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.792 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.102 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.811 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.121 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.833 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.143 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.838 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.148 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.840 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.112 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.845 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.117 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.857 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.167 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:18.862 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.134 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.468 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.740 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.469 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.741 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.481 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:20.752 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.507 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.817 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.508 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.818 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.509 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.819 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.510 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.820 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.520 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:20.830 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:19.522 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:20.832 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.868 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:25.178 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.873 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:25.183 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.885 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:25.195 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.919 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:25.190 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.920 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:25.230 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.921 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:25.192 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.924 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:25.234 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.932 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:25.203 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:23.939 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:25.249 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.897 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:40.207 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.899 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:40.208 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.912 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:40.222 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.943 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:40.215 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.947 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:40.257 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.948 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:40.219 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.948 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:40.258 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.962 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:40.234 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:38.964 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:40.274 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.939 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:50.248 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.940 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:50.250 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.953 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:27:50.262 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.984 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:50.294 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.986 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:50.296 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.987 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:50.259 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.988 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:50.260 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:48.999 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:27:50.309 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:49.000 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:50.272 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.945 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:00.255 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.949 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:00.259 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.966 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:00.276 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.992 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:00.263 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.996 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:00.306 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:58.998 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:00.270 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:59.000 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:00.309 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:59.011 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:00.283 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:45:59.013 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:00.323 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:08.978 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:10.287 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:08.984 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:10.294 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.002 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:10.312 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.032 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:10.303 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.033 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:10.305 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.037 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:10.347 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.040 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:10.350 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.045 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:10.316 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:09.053 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:10.362 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.159 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:20.469 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.161 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:20.471 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.185 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:20.494 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.206 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:20.478 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.207 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:20.479 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.217 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:20.527 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.219 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:20.490 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.219 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:20.529 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:19.231 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:20.541 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.063 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:30.373 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.064 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:30.374 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.079 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:30.388 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.110 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:30.381 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.118 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:30.428 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.119 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:30.429 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.126 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:30.398 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.132 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:30.441 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:29.141 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:30.412 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.106 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:40.415 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.108 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:40.418 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.124 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:40.434 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.156 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:40.466 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.158 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:40.468 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.171 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:40.481 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.179 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:40.450 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.196 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:40.468 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:39.208 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:40.480 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.118 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:50.428 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.124 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:50.434 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.140 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:28:50.450 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.168 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:50.439 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.170 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:50.442 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.178 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:50.488 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.180 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:50.490 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.182 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:28:50.454 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:49.193 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:28:50.503 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.150 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:00.460 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.153 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:00.463 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.169 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:00.479 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.197 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:00.469 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.199 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:00.470 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.206 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:00.516 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.211 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:00.483 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.211 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:00.521 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:46:59.224 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:00.534 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.184 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:10.494 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.186 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:10.496 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.203 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:10.513 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.228 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:10.500 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.234 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:10.505 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.246 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:10.517 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.250 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:10.560 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.252 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:10.562 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:09.266 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:10.576 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.214 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:20.524 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.216 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:20.526 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.230 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:20.540 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.259 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:20.569 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.260 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:20.531 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.263 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:20.535 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.275 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:20.547 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.279 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:20.589 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:19.293 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:20.603 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.242 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:30.552 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.244 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:30.554 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.267 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:30.577 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.290 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:30.562 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.293 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:30.564 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.299 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:30.609 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.303 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:30.613 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.306 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:30.577 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:29.332 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:30.642 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:33.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-01T03:47:35.658 INFO:tasks.ceph.osd.5:Stopped 2023-11-01T03:47:35.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-01T03:47:35.659 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:47:35.672 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:47:35.663+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 86051) UID: 0 2023-11-01T03:47:35.675 INFO:tasks.ceph.osd.6.smithi153.stderr:2023-11-01T03:47:35.664+0000 b47e640 -1 osd.6 926 *** Got signal Terminated *** 2023-11-01T03:47:39.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-01T03:47:39.277 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:40.587 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.279 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:40.589 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.294 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:40.604 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.323 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:40.594 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.326 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:40.598 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.331 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:40.641 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.332 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:40.642 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.339 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:40.610 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:39.345 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:40.655 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.254 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:50.564 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.307 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:50.617 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.325 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:29:50.635 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.352 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:50.623 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.354 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:50.626 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.367 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:29:50.638 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.378 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:50.688 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.379 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:50.690 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:49.392 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:29:50.702 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.284 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:00.594 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.337 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:00.647 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.354 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:00.664 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.381 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:00.652 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.383 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:00.693 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.385 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:00.657 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.388 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:00.698 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.398 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:00.669 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:47:59.401 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:00.711 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.368 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:10.678 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.370 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:10.680 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.384 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:10.694 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.415 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:10.686 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.416 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:10.726 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.418 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:10.690 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.419 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:10.729 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.431 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:10.702 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:09.435 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:10.745 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.392 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:20.702 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.397 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:20.706 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.414 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:20.724 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.441 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:20.712 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.445 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:20.716 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.445 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:20.755 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.448 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:20.758 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.458 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:20.730 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:19.461 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:20.771 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.473 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:30.783 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.478 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:30.788 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.496 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:30.806 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.525 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:30.797 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.529 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:30.839 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.529 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:30.801 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.530 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:30.840 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.544 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:30.816 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:29.546 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:30.856 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.269 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:31.579 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.274 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:31.584 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.287 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:31.597 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.324 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:31.595 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.326 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:31.597 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.326 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:31.636 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.328 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:31.638 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.338 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:31.610 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:30.341 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:31.651 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.504 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:40.814 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.508 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:40.818 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.525 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:40.835 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.557 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:40.828 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.560 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:40.832 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.572 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:40.844 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.573 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:40.883 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.576 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:40.886 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:39.589 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:40.899 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.543 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:50.853 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.544 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:50.854 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.559 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:30:50.869 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.587 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:50.897 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.592 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:50.902 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.593 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:50.864 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.594 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:50.866 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.606 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:30:50.916 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:49.608 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:30:50.880 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.567 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:00.877 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.569 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:00.879 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.586 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:00.896 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.614 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:00.886 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.618 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:00.889 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.618 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:00.928 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.621 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:00.931 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.631 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:00.903 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:48:59.635 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:00.945 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:07.307 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:07.303+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:08.352 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:08.350+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:09.309 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:09.305+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:09.601 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:10.911 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.603 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:10.913 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.619 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:10.929 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.645 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:10.917 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.648 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:10.920 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.655 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:10.965 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.656 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:10.966 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.661 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:10.933 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:09.670 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:10.980 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:10.316 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:10.315+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:11.313 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:11.312+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:12.294 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:12.293+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:13.336 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:13.335+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:14.324 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:14.323+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:15.340 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:15.339+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:16.347 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:16.346+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:17.355 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:17.354+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:18.320 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:18.319+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:19.305 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:19.304+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:19.578 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:20.888 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.625 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:20.897 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.627 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:20.898 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.631 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:20.941 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.641 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:20.912 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.651 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:20.961 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.682 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:20.992 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.686 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:20.996 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:19.699 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:21.009 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:20.280 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:20.279+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:21.238 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:21.237+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:22.232 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:22.230+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:23.203 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:23.202+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:24.178 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:24.177+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:25.147 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:25.146+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:26.116 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:26.115+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:27.102 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:27.101+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:28.087 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:28.086+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:29.092 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:29.090+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:29.661 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:30.971 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.663 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:30.973 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.678 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:30.987 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.708 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:30.980 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.709 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:31.019 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.712 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:31.022 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.713 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:30.984 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.726 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:31.036 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:29.726 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:30.998 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:30.052 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:30.051+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:31.088 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:31.087+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:32.049 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:32.047+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:33.002 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:33.001+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:34.035 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:34.034+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:35.053 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:35.052+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:36.011 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:36.009+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:37.047 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:37.046+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:38.028 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:38.027+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:39.023 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:39.022+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:39.688 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:40.998 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.692 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:41.002 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.709 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:41.019 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.735 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:41.007 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.741 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:41.013 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.743 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:41.053 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.745 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:41.055 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.754 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:41.026 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:39.758 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:41.068 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:40.020 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:40.018+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:41.030 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:41.028+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:42.056 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:42.055+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:43.064 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:43.063+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:44.031 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:44.030+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:44.999 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:44.998+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:46.003 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:46.002+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:46.983 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:46.982+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:48.017 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:48.016+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:49.043 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:49.042+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:49.724 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:51.034 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.726 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:51.036 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.741 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:31:51.050 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.766 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:51.038 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.772 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:51.044 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.773 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:51.082 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.777 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:51.087 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.785 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:51.057 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:49.789 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:31:51.099 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:50.012 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:50.011+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:50.984 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:50.983+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:52.001 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:52.000+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:52.952 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:52.951+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:53.919 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:53.918+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:54.930 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:54.929+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:55.945 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:55.944+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:56.950 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:56.949+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:57.964 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:57.963+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:58.990 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:58.989+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:49:59.778 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:01.088 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.782 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:01.092 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.796 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:01.106 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.823 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:01.095 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.826 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:01.098 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.839 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:01.111 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.851 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:01.161 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.854 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:01.164 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.867 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:01.177 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:49:59.976 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:49:59.975+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:01.009 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:01.008+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:01.981 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:01.980+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:02.944 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:02.943+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:03.953 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:03.952+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:04.965 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:04.963+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:05.988 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:05.987+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:07.036 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:07.035+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:08.055 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:08.054+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:09.088 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:09.087+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:09.789 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:11.098 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.793 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:11.103 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.808 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:11.118 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.839 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:11.111 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.843 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:11.153 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.844 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:11.116 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.845 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:11.155 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.857 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:11.128 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:09.859 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:11.169 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:10.077 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:10.075+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:11.034 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:11.033+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:12.018 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:12.016+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:13.034 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:13.033+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:14.070 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:14.069+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:15.037 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:15.036+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:16.036 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:16.035+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:17.045 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:17.044+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:18.043 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:18.041+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:19.077 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:19.075+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:19.953 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:21.262 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:19.955 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:21.265 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:19.972 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:21.282 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:19.999 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:21.271 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.003 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:21.274 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.016 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:21.288 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.027 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:21.337 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.028 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:21.339 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.042 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:21.352 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:20.064 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:20.062+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:21.073 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:21.071+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:22.079 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:22.078+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:23.128 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:23.127+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:24.131 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:24.130+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:25.098 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:25.097+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:26.117 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:26.116+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:27.129 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:27.128+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:28.084 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:28.082+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:29.049 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:29.048+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:29.952 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:31.261 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:29.955 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:31.265 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:29.969 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:31.279 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.002 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:31.273 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.004 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:31.276 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.005 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:31.315 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.007 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:31.317 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.017 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:31.289 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.020 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:31.329 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:30.046 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:30.045+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:31.069 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:31.068+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:32.088 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:32.087+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:33.138 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:33.137+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:34.182 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:34.181+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:35.222 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:35.221+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:36.233 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:36.232+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:37.185 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:37.184+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:38.179 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:38.178+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:39.144 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:39.143+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:40.025 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:41.335 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.027 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:41.337 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.041 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:41.351 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.074 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:41.346 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.075 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:41.385 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.075 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:41.347 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.076 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:41.386 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.086 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:41.358 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.088 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:41.398 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:40.166 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:40.165+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:41.216 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:41.215+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:42.199 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:42.198+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:43.156 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:43.154+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:44.117 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:44.115+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:45.079 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:45.078+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:46.130 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:46.129+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:47.157 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:47.155+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:48.155 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:48.154+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:49.166 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:49.165+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:50.030 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:51.340 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.031 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:51.341 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.045 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:32:51.355 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.073 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:51.344 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.076 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:51.347 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.088 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:51.360 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.097 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:51.407 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.098 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:51.408 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.109 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:32:51.419 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:50:50.136 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:50.135+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:51.171 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:51.170+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:52.169 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:52.168+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:53.201 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:53.200+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:54.192 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:54.191+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:55.173 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:55.172+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:56.138 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:56.136+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:57.099 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:57.096+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:58.056 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:58.055+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:50:59.041 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:50:59.040+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:00.051 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:01.361 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.056 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:01.366 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.057 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:00.056+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:00.071 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:01.381 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.100 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:01.371 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.102 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:01.374 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.105 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:01.415 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.107 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:01.417 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.116 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:01.387 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:00.120 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:01.430 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:01.083 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:01.081+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:02.099 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:02.098+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:03.080 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:03.078+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:04.073 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:04.072+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:05.055 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:05.054+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:06.051 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:06.050+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:07.052 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:07.051+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:08.067 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:08.066+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:09.094 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:09.093+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:10.067 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:10.066+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:10.087 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:11.397 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.090 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:11.400 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.103 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:11.413 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.135 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:11.406 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.135 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:11.445 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.137 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:11.409 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.138 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:11.448 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.150 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:11.422 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:10.151 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:11.461 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:11.032 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:11.030+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:12.069 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:12.067+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:13.074 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:13.073+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:14.050 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:14.048+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:15.016 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:15.015+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:16.013 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:16.012+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:16.967 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:16.966+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:18.005 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:18.004+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:19.050 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:19.049+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:20.074 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:20.073+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:20.129 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:21.439 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.134 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:21.444 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.149 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:21.459 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.178 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:21.488 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.182 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:21.454 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.182 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:21.492 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.185 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:21.457 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.194 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:21.504 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:20.199 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:21.471 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:21.103 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:21.102+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:22.087 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:22.086+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:23.097 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:23.096+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:24.063 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:24.062+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:25.104 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:25.103+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:26.149 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:26.148+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:27.113 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:27.112+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:28.107 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:28.106+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:29.139 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:29.138+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:30.157 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:30.156+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:30.158 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:31.468 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.163 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:31.473 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.178 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:31.488 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.211 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:31.482 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.211 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:31.521 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.212 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:31.484 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.214 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:31.524 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.225 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:31.496 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:30.227 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:31.537 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:31.181 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:31.180+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:32.138 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:32.137+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:33.097 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:33.095+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:34.078 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:34.076+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:35.094 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:35.093+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:36.065 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:36.064+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:37.105 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:37.104+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:38.059 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:38.058+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:39.047 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:39.045+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:40.034 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:40.033+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:40.190 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:41.500 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.193 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:41.503 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.206 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:41.516 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.237 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:41.509 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.238 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:41.548 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.240 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:41.512 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.241 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:41.551 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.253 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:41.525 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:40.253 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:41.563 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:41.022 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:41.021+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:42.021 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:43.331 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.057 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:42.056+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:42.071 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:43.381 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.086 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:43.396 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.123 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:43.433 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.124 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:43.395 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.124 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:43.434 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.125 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:43.397 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.137 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:43.447 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:42.138 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:43.409 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:43.105 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:43.104+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:44.117 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:44.116+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:45.162 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:45.160+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:46.198 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:46.197+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:47.202 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:47.201+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:48.154 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:48.153+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:49.108 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:49.107+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:50.084 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:50.083+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:50.224 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:51.534 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.226 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:51.536 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.236 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:33:51.546 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.273 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:51.583 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.274 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:51.545 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.274 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:51.584 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.275 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:51.547 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.285 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:33:51.595 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:50.286 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:33:51.558 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:51:51.136 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:51.135+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:52.120 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:52.119+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:53.073 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:53.072+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:54.052 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:54.051+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:55.015 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:55.013+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:55.987 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:55.985+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:57.035 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:57.033+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:58.037 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:58.035+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:51:59.072 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:51:59.070+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:00.064 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:00.063+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:00.254 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:01.564 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.256 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:01.566 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.269 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:01.579 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.300 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:01.610 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.302 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:01.574 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.303 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:01.613 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.304 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:01.576 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.317 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:01.588 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:00.317 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:01.627 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:01.026 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:01.025+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:02.047 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:02.046+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:03.082 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:03.081+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:04.092 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:04.091+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:05.096 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:05.095+0000 f259640 -1 osd.7 926 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:06.106 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:06.104+0000 f259640 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:07.083 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:07.082+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:08.134 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:08.132+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:09.095 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:09.094+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:10.123 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:10.122+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:10.310 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:11.619 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.311 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:11.621 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.326 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:11.636 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.354 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:11.664 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.357 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:11.667 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.359 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:11.631 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.361 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:11.633 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.372 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:11.682 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:10.376 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:11.647 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:11.154 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:11.153+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:12.135 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:12.134+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:13.149 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:13.148+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:14.128 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:14.127+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:15.094 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:15.093+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:16.096 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:16.094+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:17.117 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:17.116+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:18.075 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:18.074+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:19.065 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:19.064+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:20.017 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:20.016+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:20.338 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:21.648 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.340 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:21.650 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.354 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:21.664 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.382 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:21.654 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.385 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:21.657 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.385 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:21.695 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.390 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:21.700 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.399 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:21.670 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:20.406 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:21.716 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:21.032 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:21.031+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:21.983 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:21.982+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:22.953 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:22.952+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:23.919 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:23.918+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:24.920 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:24.919+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:25.895 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:25.894+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:26.867 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:26.866+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:27.896 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:27.894+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:28.865 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:28.864+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:29.897 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:29.895+0000 f259640 -1 osd.7 928 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:30.507 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:31.817 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.509 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:31.820 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.524 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:31.834 86104== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.553 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:31.825 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.556 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:31.828 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.558 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:31.868 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.559 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:31.869 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.570 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:34:31.842 85512== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.572 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:31.882 86106== Warning: unimplemented fcntl command: 1036 2023-11-01T03:52:30.871 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:30.870+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:31.852 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:31.850+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:32.810 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:32.809+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:33.850 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:33.849+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:34.724 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-01T03:52:34.725 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-01T03:52:34.725 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:52:34.726 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-11-01T03:52:34.726+0000 7fd009e30640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 86108) UID: 0 2023-11-01T03:52:34.752 INFO:tasks.ceph.mgr.y:Stopped 2023-11-01T03:52:34.753 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-01T03:52:34.753 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:52:34.774 INFO:tasks.ceph.mgr.x:Stopped 2023-11-01T03:52:34.775 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-01T03:52:34.775 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-01T03:52:34.775 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:52:34.803 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:34.802+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:34.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-11-01T03:52:34.796+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 86068) UID: 0 2023-11-01T03:52:34.808 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-11-01T03:52:34.798+0000 9f5c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-01T03:52:35.395 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:36.705 86104== 2023-11-01T03:52:35.395 INFO:tasks.ceph.mon.a.smithi005.stderr:==00:00:34:36.705 86104== Exit program on first error (--exit-on-first-error=yes) 2023-11-01T03:52:35.414 INFO:tasks.ceph.mon.a.smithi005.stderr:daemon-helper: command failed with exit status 42 2023-11-01T03:52:35.767 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:35.766+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:36.789 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:36.788+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:37.767 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:37.766+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:38.794 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:38.793+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:39.831 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:39.830+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:40.833 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:40.832+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:40.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-01T03:52:40.877 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-01T03:52:40.878 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-11-01T03:52:40.879 INFO:tasks.ceph.mon.a:Stopped 2023-11-01T03:52:40.879 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-01T03:52:40.880 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:52:40.897 INFO:tasks.ceph.mon.c.smithi005.stderr:2023-11-01T03:52:40.883+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 86070) UID: 0 2023-11-01T03:52:40.897 INFO:tasks.ceph.mon.c.smithi005.stderr:2023-11-01T03:52:40.885+0000 9f5c640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-01T03:52:41.610 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:42.920 86106== 2023-11-01T03:52:41.610 INFO:tasks.ceph.mon.c.smithi005.stderr:==00:00:34:42.920 86106== Exit program on first error (--exit-on-first-error=yes) 2023-11-01T03:52:41.626 INFO:tasks.ceph.mon.c.smithi005.stderr:daemon-helper: command failed with exit status 42 2023-11-01T03:52:41.786 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:41.785+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:42.738 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:42.736+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:43.736 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:43.735+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:44.725 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:44.724+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:45.775 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:45.774+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:46.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-01T03:52:46.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-01T03:52:46.783 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:46.782+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:46.982 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-01T03:52:46.982 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-11-01T03:52:46.983 INFO:tasks.ceph.mon.c:Stopped 2023-11-01T03:52:46.983 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-01T03:52:46.984 INFO:teuthology.orchestra.run:waiting for 300 2023-11-01T03:52:46.998 INFO:tasks.ceph.mon.b.smithi153.stderr:2023-11-01T03:52:46.987+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 85508) UID: 0 2023-11-01T03:52:46.998 INFO:tasks.ceph.mon.b.smithi153.stderr:2023-11-01T03:52:46.988+0000 9f5c640 -1 mon.b@1(probing) e1 *** Got Signal Terminated *** 2023-11-01T03:52:47.783 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:47.782+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:48.791 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:48.790+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:49.831 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:49.830+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:50.820 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:50.819+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:51.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-01T03:52:51.801 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:51.800+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:52.848 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:52.846+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:53.823 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:53.821+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:54.852 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:54.851+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:55.830 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:55.829+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:56.800 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:56.799+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:57.835 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:57.834+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:58.791 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:58.790+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:52:59.777 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:52:59.776+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:00.800 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:00.799+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:01.850 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:01.849+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:02.888 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:02.887+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:03.885 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:03.884+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:04.841 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:04.840+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:05.860 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:05.859+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:06.873 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:06.872+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:07.843 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:07.842+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:08.795 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:08.794+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:09.840 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:09.838+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:10.872 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:10.871+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:11.869 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:11.868+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:12.903 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:12.902+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:13.900 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:13.899+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:14.899 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:14.897+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:15.937 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:15.936+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:16.952 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:16.951+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:17.991 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:17.990+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:18.945 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:18.943+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:19.973 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:19.972+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:20.932 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:20.931+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:21.915 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:21.914+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:22.879 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:22.878+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:23.833 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:23.832+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:24.868 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:24.867+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:25.880 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:25.880+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:26.868 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:26.867+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:27.824 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:27.823+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:28.789 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:28.788+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:29.743 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:29.741+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:30.740 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:30.739+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:31.753 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:31.751+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:32.792 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:32.791+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:33.811 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:33.810+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:34.763 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:34.762+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:35.750 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:35.749+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:36.740 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:36.738+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:37.747 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:37.746+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:38.728 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:38.727+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:39.688 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:39.687+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:40.737 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:40.736+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:41.782 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:41.781+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:42.784 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:42.783+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:43.769 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:43.768+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:44.785 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:35:46.056 85512== 2023-11-01T03:53:44.785 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:35:46.056 85512== Exit program on first error (--exit-on-first-error=yes) 2023-11-01T03:53:44.801 INFO:tasks.ceph.mon.b.smithi153.stderr:daemon-helper: command failed with exit status 42 2023-11-01T03:53:44.802 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:44.801+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:45.764 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:45.763+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:46.813 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:46.812+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:47.805 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:47.804+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:47.998 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-01T03:53:47.999 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-11-01T03:53:48.000 INFO:tasks.ceph.mon.b:Stopped 2023-11-01T03:53:48.000 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-01T03:53:48.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2023-11-01T03:53:48.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:53:48.045 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-01T03:53:48.150 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:53:48.151 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-01T03:53:48.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:53:48.207 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-01T03:53:48.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:53:48.264 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-01T03:53:48.323 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:53:48.323 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-01T03:53:48.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:53:48.395 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-01T03:53:48.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:53:48.493 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-01T03:53:48.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:53:48.550 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:48.606 INFO:teuthology.orchestra.run.smithi153.stderr:umount: /var/lib/ceph/osd/ceph-7: target is busy. 2023-11-01T03:53:48.607 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-01T03:53:48.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-01T03:53:48.813 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:48.812+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:48.868 INFO:teuthology.orchestra.run.smithi153.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-01T03:53:48.869 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.869 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.869 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-01T03:53:48.869 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-01T03:53:48.869 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-01T03:53:48.871 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:48.871 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:48.871 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:48.871 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:48.871 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:48.872 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:48.872 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:48.872 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:48.872 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:48.872 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:48.873 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:48.874 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:48.874 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-01T03:53:48.874 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:48.874 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:48.875 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:48.875 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:48.875 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:48.876 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:48.876 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:48.876 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:48.877 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.877 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.877 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.877 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-01T03:53:48.878 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 4u a_inode 0,14 0 3101 [eventpoll:5,6,8,11,16,17,18,19,44,45,46,47,49,60,63,64,65,67,74,89,90,91,97,99,100,101,102,103,107,111,120,126...] 2023-11-01T03:53:48.878 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 5u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:48.878 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 6r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.879 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-01T03:53:48.879 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 8u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.879 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 9u a_inode 0,14 0 3101 [eventpoll:10,13] 2023-11-01T03:53:48.880 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 10r REG 0,20 0 18474 /proc/1/mountinfo 2023-11-01T03:53:48.880 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 11r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.880 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 12u netlink 0t0 16746 AUDIT 2023-11-01T03:53:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 13r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-01T03:53:48.881 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 15u netlink 0t0 16738 KOBJECT_UEVENT 2023-11-01T03:53:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 16u unix 0xffff9efbd08da200 0t0 16740 /run/systemd/private type=STREAM (LISTEN) 2023-11-01T03:53:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 17r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 18u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.882 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 19r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.883 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 20u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.883 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 21u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.883 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 22u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.883 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 23u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.884 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 24u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.884 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 25u unix 0xffff9efbd5433fc0 0t0 1227 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.884 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 26u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.885 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-01T03:53:48.885 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 28u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.885 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 29u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.886 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 30u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.886 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 31u a_inode 0,14 0 3101 bpf-prog 2023-11-01T03:53:48.886 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 44u unix 0xffff9efbc2f350c0 0t0 18482 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-01T03:53:48.887 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 45u unix 0xffff9efbc2f33b80 0t0 18481 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-01T03:53:48.887 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 46u unix 0xffff9efbc3ae8880 0t0 18476 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-01T03:53:48.887 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 47u unix 0xffff9efbc3ae9980 0t0 18477 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.887 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 48u unix 0xffff9efbc3aebfc0 0t0 18478 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.888 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 49u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.888 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 60u unix 0xffff9efbd03fb300 0t0 1503 type=STREAM (CONNECTED) 2023-11-01T03:53:48.888 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 62u unix 0xffff9efbc3aee1c0 0t0 18489 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-01T03:53:48.888 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 63u unix 0xffff9efbd03f9980 0t0 1497 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-01T03:53:48.888 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 64u CHR 10,242 0t0 165 /dev/rfkill 2023-11-01T03:53:48.889 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 65u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-01T03:53:48.889 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 67u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-01T03:53:48.889 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 68u unix 0xffff9efbd02d1dc0 0t0 20955 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-01T03:53:48.889 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 69u IPv4 18681 0t0 TCP *:sunrpc (LISTEN) 2023-11-01T03:53:48.889 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 70u IPv4 18687 0t0 UDP *:sunrpc 2023-11-01T03:53:48.890 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 71u IPv6 18693 0t0 TCP *:sunrpc (LISTEN) 2023-11-01T03:53:48.890 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 73u IPv6 18699 0t0 UDP *:sunrpc 2023-11-01T03:53:48.890 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 74u unix 0xffff9efbd1c9a640 0t0 20965 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-01T03:53:48.890 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 89u unix 0xffff9efbc2f361c0 0t0 19575 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.890 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 90u unix 0xffff9efbd03ff2c0 0t0 1445 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.891 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 91u unix 0xffff9efbd0312640 0t0 22942 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.891 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 92u unix 0xffff9efbc2f36e80 0t0 21542 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.891 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 97u unix 0xffff9efbd0221980 0t0 21553 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.891 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 99u unix 0xffff9efbd08db300 0t0 21555 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.891 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 100u unix 0xffff9efbd02d61c0 0t0 21556 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.892 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 101u unix 0xffff9efbd0221100 0t0 21560 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.892 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 102u unix 0xffff9efbd0316a40 0t0 19653 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.892 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 103u unix 0xffff9efbd0312a80 0t0 19654 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.892 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 104u unix 0xffff9efbc2f34840 0t0 21637 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.892 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 105u unix 0xffff9efbd0310000 0t0 21169 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 106u unix 0xffff9efbd02d0000 0t0 23257 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 107u unix 0xffff9efbd0317b40 0t0 165996 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 111u FIFO 0,24 0t0 447 /run/initctl 2023-11-01T03:53:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 112u unix 0xffff9efbd1c9fb40 0t0 20967 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-01T03:53:48.893 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 114u unix 0xffff9efbc3aeb740 0t0 18491 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 115u unix 0xffff9efbc2f35d80 0t0 18493 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 120r FIFO 0,13 0t0 20950 pipe 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 123u unix 0xffff9efbd03f8000 0t0 1495 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 126u unix 0xffff9efbd02d2a80 0t0 20953 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1 root 127u netlink 0t0 20969 KOBJECT_UEVENT 2023-11-01T03:53:48.894 INFO:teuthology.orchestra.run.smithi153.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.895 INFO:teuthology.orchestra.run.smithi153.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.895 INFO:teuthology.orchestra.run.smithi153.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-01T03:53:48.895 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.895 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.896 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-01T03:53:48.896 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.896 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.896 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-01T03:53:48.896 INFO:teuthology.orchestra.run.smithi153.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-01T03:53:48.897 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.898 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.898 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-01T03:53:48.898 INFO:teuthology.orchestra.run.smithi153.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.898 INFO:teuthology.orchestra.run.smithi153.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.898 INFO:teuthology.orchestra.run.smithi153.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-01T03:53:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-01T03:53:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-01T03:53:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.901 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-01T03:53:48.902 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.902 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.902 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-01T03:53:48.902 INFO:teuthology.orchestra.run.smithi153.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.902 INFO:teuthology.orchestra.run.smithi153.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.903 INFO:teuthology.orchestra.run.smithi153.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-01T03:53:48.903 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.903 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.903 INFO:teuthology.orchestra.run.smithi153.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-01T03:53:48.903 INFO:teuthology.orchestra.run.smithi153.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-01T03:53:48.904 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-01T03:53:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.906 INFO:teuthology.orchestra.run.smithi153.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-01T03:53:48.907 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.907 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.907 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-01T03:53:48.907 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.907 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.908 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-01T03:53:48.908 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.908 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.908 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-01T03:53:48.908 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-01T03:53:48.909 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-01T03:53:48.910 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.911 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.911 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-01T03:53:48.911 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.911 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.911 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.912 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-01T03:53:48.913 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.913 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.913 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-01T03:53:48.913 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.913 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.914 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-01T03:53:48.914 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.914 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.914 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-01T03:53:48.914 INFO:teuthology.orchestra.run.smithi153.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-01T03:53:48.915 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.916 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.916 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-01T03:53:48.916 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.916 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.916 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-01T03:53:48.917 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.917 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.917 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-01T03:53:48.917 INFO:teuthology.orchestra.run.smithi153.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.917 INFO:teuthology.orchestra.run.smithi153.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.918 INFO:teuthology.orchestra.run.smithi153.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-01T03:53:48.918 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.918 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.918 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-01T03:53:48.918 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-01T03:53:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.920 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.920 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-01T03:53:48.920 INFO:teuthology.orchestra.run.smithi153.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.920 INFO:teuthology.orchestra.run.smithi153.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.920 INFO:teuthology.orchestra.run.smithi153.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-01T03:53:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-01T03:53:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.921 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.922 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-01T03:53:48.922 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.922 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.922 INFO:teuthology.orchestra.run.smithi153.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-01T03:53:48.922 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-01T03:53:48.923 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.924 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.924 INFO:teuthology.orchestra.run.smithi153.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-01T03:53:48.924 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.924 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.924 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 68 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 68 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 68 root txt unknown /proc/68/exe 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.925 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-11-01T03:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-01T03:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-01T03:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-01T03:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.926 INFO:teuthology.orchestra.run.smithi153.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-01T03:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-01T03:53:48.927 INFO:teuthology.orchestra.run.smithi153.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-01T03:53:48.928 INFO:teuthology.orchestra.run.smithi153.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.929 INFO:teuthology.orchestra.run.smithi153.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.929 INFO:teuthology.orchestra.run.smithi153.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-01T03:53:48.929 INFO:teuthology.orchestra.run.smithi153.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.929 INFO:teuthology.orchestra.run.smithi153.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.929 INFO:teuthology.orchestra.run.smithi153.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-01T03:53:48.930 INFO:teuthology.orchestra.run.smithi153.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.930 INFO:teuthology.orchestra.run.smithi153.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.930 INFO:teuthology.orchestra.run.smithi153.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-01T03:53:48.930 INFO:teuthology.orchestra.run.smithi153.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.930 INFO:teuthology.orchestra.run.smithi153.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.931 INFO:teuthology.orchestra.run.smithi153.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.932 INFO:teuthology.orchestra.run.smithi153.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-11-01T03:53:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2023-11-01T03:53:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:md 87 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.934 INFO:teuthology.orchestra.run.smithi153.stdout:md 87 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.934 INFO:teuthology.orchestra.run.smithi153.stdout:md 87 root txt unknown /proc/87/exe 2023-11-01T03:53:48.934 INFO:teuthology.orchestra.run.smithi153.stdout:md_bitmap 88 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.934 INFO:teuthology.orchestra.run.smithi153.stdout:md_bitmap 88 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.934 INFO:teuthology.orchestra.run.smithi153.stdout:md_bitmap 88 root txt unknown /proc/88/exe 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.935 INFO:teuthology.orchestra.run.smithi153.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 91 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 91 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 91 root txt unknown /proc/91/exe 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 92 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 92 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.936 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 92 root txt unknown /proc/92/exe 2023-11-01T03:53:48.937 INFO:teuthology.orchestra.run.smithi153.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.937 INFO:teuthology.orchestra.run.smithi153.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.937 INFO:teuthology.orchestra.run.smithi153.stdout:kswapd0 93 root txt unknown /proc/93/exe 2023-11-01T03:53:48.937 INFO:teuthology.orchestra.run.smithi153.stdout:kthrotld 100 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.937 INFO:teuthology.orchestra.run.smithi153.stdout:kthrotld 100 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.938 INFO:teuthology.orchestra.run.smithi153.stdout:kthrotld 100 root txt unknown /proc/100/exe 2023-11-01T03:53:48.938 INFO:teuthology.orchestra.run.smithi153.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.938 INFO:teuthology.orchestra.run.smithi153.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.938 INFO:teuthology.orchestra.run.smithi153.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2023-11-01T03:53:48.938 INFO:teuthology.orchestra.run.smithi153.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.939 INFO:teuthology.orchestra.run.smithi153.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.939 INFO:teuthology.orchestra.run.smithi153.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2023-11-01T03:53:48.939 INFO:teuthology.orchestra.run.smithi153.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.939 INFO:teuthology.orchestra.run.smithi153.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.939 INFO:teuthology.orchestra.run.smithi153.stdout:kaluad 110 root txt unknown /proc/110/exe 2023-11-01T03:53:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:mld 112 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:mld 112 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:mld 112 root txt unknown /proc/112/exe 2023-11-01T03:53:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 113 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 113 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.941 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 113 root txt unknown /proc/113/exe 2023-11-01T03:53:48.941 INFO:teuthology.orchestra.run.smithi153.stdout:ipv6_addr 114 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.941 INFO:teuthology.orchestra.run.smithi153.stdout:ipv6_addr 114 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.941 INFO:teuthology.orchestra.run.smithi153.stdout:ipv6_addr 114 root txt unknown /proc/114/exe 2023-11-01T03:53:48.941 INFO:teuthology.orchestra.run.smithi153.stdout:kstrp 123 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.942 INFO:teuthology.orchestra.run.smithi153.stdout:kstrp 123 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.942 INFO:teuthology.orchestra.run.smithi153.stdout:kstrp 123 root txt unknown /proc/123/exe 2023-11-01T03:53:48.942 INFO:teuthology.orchestra.run.smithi153.stdout:zswap-shr 129 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.942 INFO:teuthology.orchestra.run.smithi153.stdout:zswap-shr 129 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.942 INFO:teuthology.orchestra.run.smithi153.stdout:zswap-shr 129 root txt unknown /proc/129/exe 2023-11-01T03:53:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 237 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 237 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 237 root txt unknown /proc/237/exe 2023-11-01T03:53:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 276 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 276 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 276 root txt unknown /proc/276/exe 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 279 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 279 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 279 root txt unknown /proc/279/exe 2023-11-01T03:53:48.944 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 283 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 283 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 283 root txt unknown /proc/283/exe 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 291 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 291 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 291 root txt unknown /proc/291/exe 2023-11-01T03:53:48.945 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 323 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 323 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 323 root txt unknown /proc/323/exe 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 352 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 352 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 352 root txt unknown /proc/352/exe 2023-11-01T03:53:48.946 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 376 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.947 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 376 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.947 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 376 root txt unknown /proc/376/exe 2023-11-01T03:53:48.947 INFO:teuthology.orchestra.run.smithi153.stdout:ata_sff 425 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.947 INFO:teuthology.orchestra.run.smithi153.stdout:ata_sff 425 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.947 INFO:teuthology.orchestra.run.smithi153.stdout:ata_sff 425 root txt unknown /proc/425/exe 2023-11-01T03:53:48.948 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-wq 428 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.948 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-wq 428 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.948 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-wq 428 root txt unknown /proc/428/exe 2023-11-01T03:53:48.948 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-rese 431 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.948 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-rese 431 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-rese 431 root txt unknown /proc/431/exe 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-dele 432 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-dele 432 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-dele 432 root txt unknown /proc/432/exe 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-auth 433 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.949 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-auth 433 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.950 INFO:teuthology.orchestra.run.smithi153.stdout:nvme-auth 433 root txt unknown /proc/433/exe 2023-11-01T03:53:48.950 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_0 443 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.950 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_0 443 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.950 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_0 443 root txt unknown /proc/443/exe 2023-11-01T03:53:48.950 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 444 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.951 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 444 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.951 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 444 root txt unknown /proc/444/exe 2023-11-01T03:53:48.951 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_1 445 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.951 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_1 445 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.951 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_1 445 root txt unknown /proc/445/exe 2023-11-01T03:53:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 446 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 446 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 446 root txt unknown /proc/446/exe 2023-11-01T03:53:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_2 447 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.952 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_2 447 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_2 447 root txt unknown /proc/447/exe 2023-11-01T03:53:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 448 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 448 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 448 root txt unknown /proc/448/exe 2023-11-01T03:53:48.953 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_3 449 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_3 449 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_3 449 root txt unknown /proc/449/exe 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 450 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 450 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe 2023-11-01T03:53:48.954 INFO:teuthology.orchestra.run.smithi153.stdout:ixgbe 452 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:ixgbe 452 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:ixgbe 452 root txt unknown /proc/452/exe 2023-11-01T03:53:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_4 453 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_4 453 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.955 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_4 453 root txt unknown /proc/453/exe 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_5 455 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_5 455 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.956 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_5 455 root txt unknown /proc/455/exe 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_6 457 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_6 457 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.957 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_6 457 root txt unknown /proc/457/exe 2023-11-01T03:53:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2023-11-01T03:53:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_7 459 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_7 459 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_7 459 root txt unknown /proc/459/exe 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 460 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 460 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_8 461 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.959 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_8 461 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_8 461 root txt unknown /proc/461/exe 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_9 463 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.960 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_9 463 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.961 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_eh_9 463 root txt unknown /proc/463/exe 2023-11-01T03:53:48.961 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.961 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.961 INFO:teuthology.orchestra.run.smithi153.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2023-11-01T03:53:48.961 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 471 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 471 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 471 root txt unknown /proc/471/exe 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 478 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 478 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 478 root txt unknown /proc/478/exe 2023-11-01T03:53:48.962 INFO:teuthology.orchestra.run.smithi153.stdout:jbd2/sda1 489 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.963 INFO:teuthology.orchestra.run.smithi153.stdout:jbd2/sda1 489 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.963 INFO:teuthology.orchestra.run.smithi153.stdout:jbd2/sda1 489 root txt unknown /proc/489/exe 2023-11-01T03:53:48.963 INFO:teuthology.orchestra.run.smithi153.stdout:ext4-rsv- 490 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.963 INFO:teuthology.orchestra.run.smithi153.stdout:ext4-rsv- 490 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.963 INFO:teuthology.orchestra.run.smithi153.stdout:ext4-rsv- 490 root txt unknown /proc/490/exe 2023-11-01T03:53:48.964 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.964 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.964 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-01T03:53:48.964 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:48.964 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:48.965 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:48.966 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:48.967 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:48.968 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:48.968 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:48.968 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:48.968 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:48.968 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:48.969 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:48.969 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:48.969 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:48.969 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:48.969 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-01T03:53:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.970 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 3u unix 0xffff9efbc3aee1c0 0t0 18489 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 4u unix 0xffff9efbc3aeb740 0t0 18491 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 5u unix 0xffff9efbc2f35d80 0t0 18493 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-01T03:53:48.971 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 7u a_inode 0,14 0 3101 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,23,24,25,27,28,29,30,32,33] 2023-11-01T03:53:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-01T03:53:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 9u unix 0xffff9efbd0311980 0t0 185 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-01T03:53:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 10r REG 0,20 0 41 /proc/sys/kernel/hostname 2023-11-01T03:53:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 11u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:48.972 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 12u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 13u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 14u unix 0xffff9efbd09c5d80 0t0 186 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 15u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 17u unix 0xffff9efbc2f361c0 0t0 19575 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.973 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 18u unix 0xffff9efbd0312640 0t0 22942 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.974 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 19u unix 0xffff9efbd03ff2c0 0t0 1445 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.974 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 20u unix 0xffff9efbc2f36e80 0t0 21542 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.974 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 21u unix 0xffff9efbd0317b40 0t0 165996 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.974 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 23u unix 0xffff9efbd0221980 0t0 21553 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.974 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 24u unix 0xffff9efbd08db300 0t0 21555 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 25u unix 0xffff9efbd02d61c0 0t0 21556 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 27u unix 0xffff9efbd0316a40 0t0 19653 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 28u unix 0xffff9efbd0221100 0t0 21560 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 29u unix 0xffff9efbd0312a80 0t0 19654 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 30u unix 0xffff9efbc2f34840 0t0 21637 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.975 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 32u unix 0xffff9efbd0310000 0t0 21169 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-j 565 root 33u unix 0xffff9efbd02d0000 0t0 23257 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-01T03:53:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:ext4lazyi 571 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:ext4lazyi 571 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:ext4lazyi 571 root txt unknown /proc/571/exe 2023-11-01T03:53:48.976 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.977 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.977 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-01T03:53:48.977 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-01T03:53:48.977 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-01T03:53:48.977 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-01T03:53:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-01T03:53:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-01T03:53:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-01T03:53:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:48.978 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:48.979 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:48.980 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:48.980 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:48.980 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:48.980 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:48.980 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:48.981 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:48.981 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:48.981 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:48.981 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:48.981 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:48.982 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:48.983 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:48.983 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:48.983 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:48.983 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:48.983 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 1u unix 0xffff9efbc2f36a40 0t0 18736 type=STREAM (CONNECTED) 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 2u unix 0xffff9efbc2f36a40 0t0 18736 type=STREAM (CONNECTED) 2023-11-01T03:53:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 3u netlink 0t0 20969 KOBJECT_UEVENT 2023-11-01T03:53:48.985 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 4u unix 0xffff9efbd1c9fb40 0t0 20967 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-01T03:53:48.985 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 5u unix 0xffff9efbc3aed500 0t0 18748 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.985 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 6u unix 0xffff9efbc3ae9dc0 0t0 18752 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.985 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 7u unix 0xffff9efbc3aedd80 0t0 18753 type=DGRAM (CONNECTED) 2023-11-01T03:53:48.985 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:48.986 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 9u a_inode 0,14 0 3101 [eventpoll:3,4,6,8,10,11,14] 2023-11-01T03:53:48.986 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 10u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:48.986 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 11u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.986 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-01T03:53:48.986 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-u 580 root 14u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:ipmi-msgh 633 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:ipmi-msgh 633 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:ipmi-msgh 633 root txt unknown /proc/633/exe 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:kipmi0 648 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:kipmi0 648 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:kipmi0 648 root txt unknown /proc/648/exe 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:48.988 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:48.989 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:48.989 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:48.989 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:48.989 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:48.990 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:48.990 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:48.990 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:48.990 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:48.990 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-01T03:53:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 1u unix 0xffff9efbd03ffb40 0t0 1442 type=STREAM (CONNECTED) 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 2u unix 0xffff9efbd03ffb40 0t0 1442 type=STREAM (CONNECTED) 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 3u unix 0xffff9efbd02d1dc0 0t0 20955 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 4u IPv4 18681 0t0 TCP *:sunrpc (LISTEN) 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 5u IPv4 18687 0t0 UDP *:sunrpc 2023-11-01T03:53:48.993 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 6u IPv6 18693 0t0 TCP *:sunrpc (LISTEN) 2023-11-01T03:53:48.994 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 7u IPv6 18699 0t0 UDP *:sunrpc 2023-11-01T03:53:48.994 INFO:teuthology.orchestra.run.smithi153.stdout:rpcbind 655 rpc 8rW REG 0,24 0 1071 /run/rpcbind/rpcbind.lock 2023-11-01T03:53:48.994 INFO:teuthology.orchestra.run.smithi153.stdout:rpciod 659 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.994 INFO:teuthology.orchestra.run.smithi153.stdout:rpciod 659 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:rpciod 659 root txt unknown /proc/659/exe 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:xprtiod 660 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:xprtiod 660 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:xprtiod 660 root txt unknown /proc/660/exe 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:48.995 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:48.996 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-01T03:53:48.996 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:48.996 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:48.996 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:48.996 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:48.997 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-01T03:53:48.998 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 3u netlink 0t0 14915 AUDIT 2023-11-01T03:53:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 4w REG 8,1 5686900 64148 /var/log/audit/audit.log 2023-11-01T03:53:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 6u unix 0xffff9efbd54361c0 0t0 1466 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 7u unix 0xffff9efbd03fee80 0t0 1465 type=STREAM (CONNECTED) 2023-11-01T03:53:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 8u unix 0xffff9efbd03fd940 0t0 1467 type=STREAM (CONNECTED) 2023-11-01T03:53:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 9u unix 0xffff9efbd03f8880 0t0 1468 type=STREAM (CONNECTED) 2023-11-01T03:53:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 root 10u a_inode 0,14 0 3101 [eventfd:0] 2023-11-01T03:53:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-01T03:53:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.002 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.003 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.004 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 3u netlink 0t0 14915 AUDIT 2023-11-01T03:53:49.005 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 4w REG 8,1 5686900 64148 /var/log/audit/audit.log 2023-11-01T03:53:49.005 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 6u unix 0xffff9efbd54361c0 0t0 1466 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.005 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 7u unix 0xffff9efbd03fee80 0t0 1465 type=STREAM (CONNECTED) 2023-11-01T03:53:49.005 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 8u unix 0xffff9efbd03fd940 0t0 1467 type=STREAM (CONNECTED) 2023-11-01T03:53:49.005 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 9u unix 0xffff9efbd03f8880 0t0 1468 type=STREAM (CONNECTED) 2023-11-01T03:53:49.006 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 662 auditd root 10u a_inode 0,14 0 3101 [eventfd:0] 2023-11-01T03:53:49.006 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.006 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.006 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-01T03:53:49.006 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.009 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.009 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.009 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-01T03:53:49.009 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.009 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 3u netlink 0t0 14915 AUDIT 2023-11-01T03:53:49.010 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 4w REG 8,1 5686900 64148 /var/log/audit/audit.log 2023-11-01T03:53:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 6u unix 0xffff9efbd54361c0 0t0 1466 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 7u unix 0xffff9efbd03fee80 0t0 1465 type=STREAM (CONNECTED) 2023-11-01T03:53:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 8u unix 0xffff9efbd03fd940 0t0 1467 type=STREAM (CONNECTED) 2023-11-01T03:53:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 9u unix 0xffff9efbd03f8880 0t0 1468 type=STREAM (CONNECTED) 2023-11-01T03:53:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:auditd 661 664 auditd root 10u a_inode 0,14 0 3101 [eventfd:0] 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.013 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.013 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.013 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.013 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.013 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-01T03:53:49.014 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root 0u unix 0xffff9efbd03fa200 0t0 1464 type=STREAM (CONNECTED) 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.015 INFO:teuthology.orchestra.run.smithi153.stdout:sedispatc 663 root 3u unix 0xffff9efbd029a640 0t0 27731 type=STREAM (CONNECTED) 2023-11-01T03:53:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-01T03:53:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2023-11-01T03:53:49.016 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.017 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.018 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.019 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.019 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.019 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.019 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.019 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 1u unix 0xffff9efbd0315d80 0t0 21528 type=STREAM (CONNECTED) 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 2u unix 0xffff9efbd0315d80 0t0 21528 type=STREAM (CONNECTED) 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 3u unix 0xffff9efbd03f8000 0t0 1495 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 4u unix 0xffff9efbd09c50c0 0t0 21538 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 5u a_inode 0,14 0 3101 [eventpoll:6,7,8,9,10,11] 2023-11-01T03:53:49.020 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 6u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:49.021 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 7r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.021 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 8u unix 0xffff9efbd0314840 0t0 21540 type=STREAM (CONNECTED) 2023-11-01T03:53:49.021 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 9u unix 0xffff9efbd0224c80 0t0 17697 type=STREAM (CONNECTED) 2023-11-01T03:53:49.021 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 10u a_inode 0,14 0 3101 [pidfd:701] 2023-11-01T03:53:49.021 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 11u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.022 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 700 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2023-11-01T03:53:49.022 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.022 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.022 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-01T03:53:49.022 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.023 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 1u unix 0xffff9efbd0315d80 0t0 21528 type=STREAM (CONNECTED) 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 2u unix 0xffff9efbd0315d80 0t0 21528 type=STREAM (CONNECTED) 2023-11-01T03:53:49.024 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 3u sock 0,8 0t0 22945 protocol: NETLINK 2023-11-01T03:53:49.025 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 4u unix 0xffff9efbd09c50c0 0t0 21538 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.025 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 5u a_inode 0,14 0 3101 [eventpoll:6,7,8,9,10,11,12,13,14,15,18,19] 2023-11-01T03:53:49.025 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 6u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:49.025 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 7u unix 0xffff9efbd03f8000 0t0 1495 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 8u unix 0xffff9efbd03faa80 0t0 22946 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 9u unix 0xffff9efbd0311540 0t0 21541 type=STREAM (CONNECTED) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 10u unix 0xffff9efbd0223fc0 0t0 21543 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 11u unix 0xffff9efbd02261c0 0t0 14926 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 12u unix 0xffff9efbd08de1c0 0t0 18876 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 13u unix 0xffff9efbc2f372c0 0t0 21617 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 14u unix 0xffff9efbd029dd80 0t0 20160 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 15u unix 0xffff9efbd0313b80 0t0 14945 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 18u unix 0xffff9efbd08d9540 0t0 19090 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:dbus-brok 701 dbus 19u unix 0xffff9efbd02d7700 0t0 15124 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.027 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.028 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-01T03:53:49.028 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.028 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-01T03:53:49.028 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.028 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.029 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.030 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.030 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.030 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.030 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.030 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.031 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.031 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.031 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.031 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.031 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.032 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.033 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.033 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.033 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.033 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.033 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.034 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.035 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-01T03:53:49.035 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.035 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.035 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.035 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.036 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.036 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.036 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.036 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.036 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-01T03:53:49.037 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-01T03:53:49.037 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.037 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.037 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.037 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.038 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.038 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.038 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-01T03:53:49.038 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.038 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.039 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.039 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.039 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.039 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.039 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.040 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 1u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.041 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 2u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.042 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 3u a_inode 0,14 0 3101 [eventfd:6] 2023-11-01T03:53:49.042 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 4u a_inode 0,14 0 3101 [eventfd:7] 2023-11-01T03:53:49.042 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 5u unix 0xffff9efbc3aefb40 0t0 18878 type=DGRAM (UNCONNECTED) 2023-11-01T03:53:49.042 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 6u unix 0xffff9efbc2f35940 0t0 18879 type=STREAM (CONNECTED) 2023-11-01T03:53:49.042 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 7u a_inode 0,14 0 3101 [eventfd:8] 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 8r REG 0,4 0 4026531840 net 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 9r REG 0,4 0 4026532495 mnt 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 10u netlink 0t0 18883 KOBJECT_UEVENT 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 11u netlink 0t0 18884 GENERIC 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 12u netlink 0t0 18885 GENERIC 2023-11-01T03:53:49.043 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 13u netlink 0t0 18886 ROUTE 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 14r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 15r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 16u netlink 0t0 18979 KOBJECT_UEVENT 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 17u unix 0xffff9efbd0314400 0t0 21619 type=STREAM (CONNECTED) 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 18u a_inode 0,14 0 3101 [eventpoll] 2023-11-01T03:53:49.044 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 19u a_inode 0,14 0 3101 [eventpoll:21,26] 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 20w FIFO 0,24 0t0 1160 /run/systemd/inhibit/1.ref 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 21u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 23u a_inode 0,14 0 3101 [eventpoll:24,25] 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 24u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 25u pack 17763 0t0 ARP type=SOCK_DGRAM 2023-11-01T03:53:49.045 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 root 26u IPv4 17764 0t0 UDP smithi153.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-01T03:53:49.046 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-01T03:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-01T03:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-01T03:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.047 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.048 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.049 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.050 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.051 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.052 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.053 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-01T03:53:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-01T03:53:49.054 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.055 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.055 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.055 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.055 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.055 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.056 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.057 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.058 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.058 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.058 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.058 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.058 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 1u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 2u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 3u a_inode 0,14 0 3101 [eventfd:6] 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 4u a_inode 0,14 0 3101 [eventfd:7] 2023-11-01T03:53:49.059 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 5u unix 0xffff9efbc3aefb40 0t0 18878 type=DGRAM (UNCONNECTED) 2023-11-01T03:53:49.060 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 6u unix 0xffff9efbc2f35940 0t0 18879 type=STREAM (CONNECTED) 2023-11-01T03:53:49.060 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 7u a_inode 0,14 0 3101 [eventfd:8] 2023-11-01T03:53:49.060 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 8r REG 0,4 0 4026531840 net 2023-11-01T03:53:49.060 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-01T03:53:49.060 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 10u netlink 0t0 18883 KOBJECT_UEVENT 2023-11-01T03:53:49.061 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 11u netlink 0t0 18884 GENERIC 2023-11-01T03:53:49.061 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 12u netlink 0t0 18885 GENERIC 2023-11-01T03:53:49.061 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 13u netlink 0t0 18886 ROUTE 2023-11-01T03:53:49.061 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 14r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.061 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 15r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 16u netlink 0t0 18979 KOBJECT_UEVENT 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 17u unix 0xffff9efbd0314400 0t0 21619 type=STREAM (CONNECTED) 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 18u a_inode 0,14 0 3101 [eventpoll] 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 19u a_inode 0,14 0 3101 [eventpoll:21,26] 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 20w FIFO 0,24 0t0 1160 /run/systemd/inhibit/1.ref 2023-11-01T03:53:49.062 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 21u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.063 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 23u a_inode 0,14 0 3101 [eventpoll:24,25] 2023-11-01T03:53:49.063 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 24u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.063 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 25u pack 17763 0t0 ARP type=SOCK_DGRAM 2023-11-01T03:53:49.063 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 730 gmain root 26u IPv4 17764 0t0 UDP smithi153.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-01T03:53:49.063 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.064 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.064 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-01T03:53:49.064 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.064 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-01T03:53:49.064 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-01T03:53:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-01T03:53:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-01T03:53:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.065 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.066 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.066 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.066 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.066 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.066 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.068 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.069 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.069 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.069 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.069 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.069 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.071 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-01T03:53:49.072 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.073 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.074 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-01T03:53:49.074 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.074 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.074 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.074 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.075 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.077 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.077 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 1u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.077 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 2u unix 0xffff9efbc2f36600 0t0 18855 type=STREAM (CONNECTED) 2023-11-01T03:53:49.077 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 3u a_inode 0,14 0 3101 [eventfd:6] 2023-11-01T03:53:49.077 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 4u a_inode 0,14 0 3101 [eventfd:7] 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 5u unix 0xffff9efbc3aefb40 0t0 18878 type=DGRAM (UNCONNECTED) 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 6u unix 0xffff9efbc2f35940 0t0 18879 type=STREAM (CONNECTED) 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 7u a_inode 0,14 0 3101 [eventfd:8] 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-01T03:53:49.078 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 10u netlink 0t0 18883 KOBJECT_UEVENT 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 11u netlink 0t0 18884 GENERIC 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 12u netlink 0t0 18885 GENERIC 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 13u netlink 0t0 18886 ROUTE 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 14r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 15r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.079 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 16u netlink 0t0 18979 KOBJECT_UEVENT 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 17u unix 0xffff9efbd0314400 0t0 21619 type=STREAM (CONNECTED) 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 18u a_inode 0,14 0 3101 [eventpoll] 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 19u a_inode 0,14 0 3101 [eventpoll:21,26] 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 20w FIFO 0,24 0t0 1160 /run/systemd/inhibit/1.ref 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 21u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.080 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 23u a_inode 0,14 0 3101 [eventpoll:24,25] 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 24u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 25u pack 17763 0t0 ARP type=SOCK_DGRAM 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:NetworkMa 702 731 gdbus root 26u IPv4 17764 0t0 UDP smithi153.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.081 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-01T03:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.082 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 1u unix 0xffff9efbd0220000 0t0 17701 type=STREAM (CONNECTED) 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 2u unix 0xffff9efbd0220000 0t0 17701 type=STREAM (CONNECTED) 2023-11-01T03:53:49.083 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 3u a_inode 0,14 0 3101 [eventfd:1] 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 4u a_inode 0,14 0 3101 [eventfd:2] 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 5u unix 0xffff9efbd02d0880 0t0 21144 /run/irqbalance/irqbalance705.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 root 6u unix 0xffff9efbd1c98000 0t0 21254 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.084 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.085 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.086 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.086 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.086 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 1u unix 0xffff9efbd0220000 0t0 17701 type=STREAM (CONNECTED) 2023-11-01T03:53:49.086 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 2u unix 0xffff9efbd0220000 0t0 17701 type=STREAM (CONNECTED) 2023-11-01T03:53:49.086 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 3u a_inode 0,14 0 3101 [eventfd:1] 2023-11-01T03:53:49.087 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 4u a_inode 0,14 0 3101 [eventfd:2] 2023-11-01T03:53:49.087 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 5u unix 0xffff9efbd02d0880 0t0 21144 /run/irqbalance/irqbalance705.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.087 INFO:teuthology.orchestra.run.smithi153.stdout:irqbalanc 705 712 gmain root 6u unix 0xffff9efbd1c98000 0t0 21254 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.087 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.087 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 1u unix 0xffff9efbd08ddd80 0t0 22958 type=STREAM (CONNECTED) 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 2u unix 0xffff9efbd08ddd80 0t0 22958 type=STREAM (CONNECTED) 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 3uW REG 0,24 0 1112 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 5u unix 0xffff9efbd08d8000 0t0 22967 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:lsmd 706 libstoragemgmt 6u unix 0xffff9efbd02d6e80 0t0 21136 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.090 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-01T03:53:49.090 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.090 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.090 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.090 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root 1u unix 0xffff9efbd02d7b40 0t0 21131 type=STREAM (CONNECTED) 2023-11-01T03:53:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root 2u unix 0xffff9efbd02d7b40 0t0 21131 type=STREAM (CONNECTED) 2023-11-01T03:53:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-01T03:53:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:mcelog 707 root 4u unix 0xffff9efbd02d5940 0t0 21141 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-01T03:53:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.091 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.092 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.093 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.093 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.093 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.093 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.093 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.094 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.095 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.096 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.097 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.097 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.097 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.097 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.097 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.098 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.098 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.098 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.098 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.098 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.099 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.100 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.100 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.100 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.100 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.100 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.102 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.102 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.102 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.102 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.102 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.104 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 720 gmain polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.108 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.108 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.108 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.108 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.108 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.109 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.109 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.109 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.109 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.109 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.110 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.110 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.110 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.110 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.110 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.111 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.112 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 721 gdbus polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.115 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.115 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.115 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.115 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.115 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.116 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.117 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.118 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.118 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.118 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.118 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.118 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.119 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.119 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.119 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.119 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.119 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.120 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.121 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 722 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.121 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.121 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.121 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.121 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.122 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.123 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.124 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.124 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.124 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.124 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.124 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.126 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 723 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.128 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.129 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.130 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.130 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.130 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.130 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.130 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.131 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.132 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.134 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.135 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 724 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.136 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.137 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.138 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.138 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.138 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.138 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.138 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.139 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.139 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.139 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.139 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.139 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.140 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.141 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.142 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.143 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.143 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.143 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.143 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 725 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.143 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.144 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.145 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.146 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.146 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.146 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.146 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.146 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.147 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.148 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.149 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.150 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.150 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.150 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.150 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.150 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 726 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.153 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.154 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.155 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.156 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.156 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.156 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.156 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.157 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 727 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.158 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.159 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.160 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.161 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.162 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.163 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.164 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.164 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.164 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.164 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.164 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 728 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.165 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.166 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.167 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.168 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.169 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.170 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.171 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.172 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.172 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.172 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.172 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 729 JS\x20Hel polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.172 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-01T03:53:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.174 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.174 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.174 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.174 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.174 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.175 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.176 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-01T03:53:49.176 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.176 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.176 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.177 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.177 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.177 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.177 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.177 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.178 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.178 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.178 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-01T03:53:49.178 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.178 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 3r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 4u a_inode 0,14 0 3101 [eventfd:3] 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 5u a_inode 0,14 0 3101 [eventfd:4] 2023-11-01T03:53:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 6u unix 0xffff9efbd08de600 0t0 23003 type=STREAM (CONNECTED) 2023-11-01T03:53:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 7u a_inode 0,14 0 3101 [eventfd:5] 2023-11-01T03:53:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 8r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 9u a_inode 0,14 0 3101 [eventfd:10] 2023-11-01T03:53:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:polkitd 708 734 polkitd polkitd 10u unix 0xffff9efbd08ee1c0 0t0 23005 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.182 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.183 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.184 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.184 INFO:teuthology.orchestra.run.smithi153.stdout:smartd 709 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.184 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.184 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.184 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.185 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.186 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.187 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.187 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.187 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.187 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:49.187 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:49.188 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:49.189 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-01T03:53:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 1u unix 0xffff9efbd0227700 0t0 17711 type=STREAM (CONNECTED) 2023-11-01T03:53:49.191 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 2u unix 0xffff9efbd0227700 0t0 17711 type=STREAM (CONNECTED) 2023-11-01T03:53:49.191 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 3u unix 0xffff9efbd7e40880 0t0 17736 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.191 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 4u a_inode 0,14 0 3101 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-01T03:53:49.191 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 5u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:49.191 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 6u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.192 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 7r REG 0,21 4096 22923 /sys/devices/virtual/tty/tty0/active 2023-11-01T03:53:49.192 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 8u netlink 0t0 17747 KOBJECT_UEVENT 2023-11-01T03:53:49.192 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 9r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.192 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 10r FIFO 0,24 0t0 1160 /run/systemd/inhibit/1.ref 2023-11-01T03:53:49.192 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 11u netlink 0t0 17748 KOBJECT_UEVENT 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 12u netlink 0t0 17749 KOBJECT_UEVENT 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 13u netlink 0t0 17750 KOBJECT_UEVENT 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 14u unix 0xffff9efbd0226600 0t0 17751 type=STREAM (CONNECTED) 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 15u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-01T03:53:49.193 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:systemd-l 711 root 20r FIFO 0,24 0t0 1605 /run/systemd/sessions/4.ref 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.194 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.195 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.196 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.197 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.197 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.197 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.197 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.197 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.198 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.198 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.198 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.198 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.198 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.199 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.199 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.199 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.199 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.199 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root 1u unix 0xffff9efbd03150c0 0t0 21634 type=STREAM (CONNECTED) 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root 2u unix 0xffff9efbd03150c0 0t0 21634 type=STREAM (CONNECTED) 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root 3u IPv4 21164 0t0 TCP *:ssh (LISTEN) 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 756 root 4u IPv6 21166 0t0 TCP *:ssh (LISTEN) 2023-11-01T03:53:49.200 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.201 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-01T03:53:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.202 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.203 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.204 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.205 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.206 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.207 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.208 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.208 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.208 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.208 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.208 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-01T03:53:49.209 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 1u unix 0xffff9efbc2f34400 0t0 19054 type=STREAM (CONNECTED) 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 2u unix 0xffff9efbc2f34400 0t0 19054 type=STREAM (CONNECTED) 2023-11-01T03:53:49.211 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 4u sock 0,8 0t0 23063 protocol: NETLINK 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 5u unix 0xffff9efbd08dc400 0t0 23079 type=STREAM (CONNECTED) 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 6u a_inode 0,14 0 3101 [eventfd:17] 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 7u unix 0xffff9efbc2f32640 0t0 19092 type=STREAM (CONNECTED) 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 root 8u unix 0xffff9efbc2f37b40 0t0 19093 type=STREAM (CONNECTED) 2023-11-01T03:53:49.212 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.213 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.213 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-01T03:53:49.213 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.213 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.213 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-01T03:53:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.214 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-01T03:53:49.215 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.216 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-01T03:53:49.216 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-01T03:53:49.216 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-01T03:53:49.216 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-01T03:53:49.216 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.217 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.218 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.218 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-01T03:53:49.218 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-01T03:53:49.218 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.218 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-01T03:53:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.219 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.220 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.221 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.221 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.221 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.221 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.221 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.222 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.222 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.222 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.222 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-01T03:53:49.222 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.223 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.223 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.223 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.223 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.223 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.224 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.224 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.224 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.224 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 1u unix 0xffff9efbc2f34400 0t0 19054 type=STREAM (CONNECTED) 2023-11-01T03:53:49.224 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 2u unix 0xffff9efbc2f34400 0t0 19054 type=STREAM (CONNECTED) 2023-11-01T03:53:49.225 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-01T03:53:49.225 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 4u sock 0,8 0t0 23063 protocol: NETLINK 2023-11-01T03:53:49.225 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 5u unix 0xffff9efbd08dc400 0t0 23079 type=STREAM (CONNECTED) 2023-11-01T03:53:49.225 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 6u a_inode 0,14 0 3101 [eventfd:17] 2023-11-01T03:53:49.225 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 7u unix 0xffff9efbc2f32640 0t0 19092 type=STREAM (CONNECTED) 2023-11-01T03:53:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:tuned 759 850 tuned root 8u unix 0xffff9efbc2f37b40 0t0 19093 type=STREAM (CONNECTED) 2023-11-01T03:53:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.228 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.228 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.228 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.228 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.228 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.229 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.231 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.231 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.231 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.231 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.232 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.233 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.234 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.235 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.236 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.237 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.238 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.238 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.238 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.238 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.238 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.239 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.240 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.241 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.241 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.241 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.241 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.241 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.242 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.242 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.242 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.242 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.242 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.243 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.244 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.244 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.244 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 770 gssproxy root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.244 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.244 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.245 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.246 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.247 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.248 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.248 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.248 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.248 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.248 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.249 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.250 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.250 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.250 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.250 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.250 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.251 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.252 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 771 gssproxy root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.253 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.254 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.254 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.254 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.254 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.254 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.255 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.257 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.259 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.260 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.261 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 772 gssproxy root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.262 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.263 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.264 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.265 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.265 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.265 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.265 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.265 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.266 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.267 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.268 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.268 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.268 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.268 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.268 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.269 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.269 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.269 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.269 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.269 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.270 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.270 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.270 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.270 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.270 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.271 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.271 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.271 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.271 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 773 gssproxy root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.271 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.272 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.272 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-01T03:53:49.272 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.272 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.272 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-01T03:53:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-01T03:53:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.273 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.274 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.275 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-01T03:53:49.276 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-01T03:53:49.277 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-01T03:53:49.277 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.277 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.277 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-01T03:53:49.277 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.278 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.278 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.278 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.278 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.279 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.279 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.279 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.279 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.279 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 1u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 2u unix 0xffff9efbd0311dc0 0t0 21630 type=STREAM (CONNECTED) 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 3u unix 0xffff9efbd0867700 0t0 14984 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 4r FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 5u a_inode 0,14 0 3101 [eventpoll:4,6,7,8] 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 6u a_inode 0,14 0 3101 [eventfd:16] 2023-11-01T03:53:49.280 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 7u unix 0xffff9efbd0299100 0t0 14985 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 8u unix 0xffff9efbd029f700 0t0 14986 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:gssproxy 769 774 gssproxy root 9w FIFO 0,13 0t0 14989 pipe 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-01T03:53:49.281 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.282 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.282 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.282 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.282 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.282 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.283 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.283 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.283 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.283 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.283 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:atd 776 root 3uW REG 0,24 4 1183 /run/atd.pid 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-01T03:53:49.284 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.285 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.286 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.286 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.286 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.286 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.286 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.287 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.288 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 1u unix 0xffff9efbd0313300 0t0 21656 type=STREAM (CONNECTED) 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 2u unix 0xffff9efbd0313300 0t0 21656 type=STREAM (CONNECTED) 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 3uW REG 0,24 4 1182 /run/crond.pid 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 4u unix 0xffff9efbc3aec400 0t0 19062 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:crond 777 root 5r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.289 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.290 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-01T03:53:49.290 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.290 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.290 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.291 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 3u IPv4 19125 0t0 TCP *:nrpe (LISTEN) 2023-11-01T03:53:49.292 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 4u unix 0xffff9efbc3ae8000 0t0 19117 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.292 INFO:teuthology.orchestra.run.smithi153.stdout:nrpe 869 nrpe 5u IPv6 19126 0t0 TCP *:nrpe (LISTEN) 2023-11-01T03:53:49.292 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.292 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.292 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-01T03:53:49.293 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-01T03:53:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-01T03:53:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1378 root 4r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-01T03:53:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.295 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.297 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-01T03:53:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-01T03:53:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-01T03:53:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:agetty 1379 root 4r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.298 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu DEL REG 8,1 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.299 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.300 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.300 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.300 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.300 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-01T03:53:49.300 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.301 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.302 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-01T03:53:49.302 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:49.302 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.302 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.302 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.303 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.303 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:49.303 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.303 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.303 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.304 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 1u unix 0xffff9efbd02d1980 0t0 21321 type=STREAM (CONNECTED) 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 2u unix 0xffff9efbd02d1980 0t0 21321 type=STREAM (CONNECTED) 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 3u unix 0xffff9efbd1c9f2c0 0t0 21349 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 4u a_inode 0,14 0 3101 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-01T03:53:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 5u a_inode 0,14 0 3101 [signalfd] 2023-11-01T03:53:49.306 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 6r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.306 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 7r DIR 0,25 0 3391 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-01T03:53:49.306 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 8u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.306 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 9u a_inode 0,14 0 3101 [eventpoll:10,13] 2023-11-01T03:53:49.306 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 10r REG 0,20 0 21338 /proc/1404/mountinfo 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 11r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 12u unix 0xffff9efbc2f32a80 0t0 19277 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 13r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 15u netlink 0t0 21353 KOBJECT_UEVENT 2023-11-01T03:53:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 16u unix 0xffff9efbd1c99100 0t0 21358 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-01T03:53:49.308 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 17u unix 0xffff9efbd1c9cc80 0t0 21359 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.308 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 18u unix 0xffff9efbd1c9c840 0t0 21360 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.308 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 19u unix 0xffff9efbd02d3fc0 0t0 21361 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-01T03:53:49.308 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 20u unix 0xffff9efbd02d4c80 0t0 21363 type=STREAM (CONNECTED) 2023-11-01T03:53:49.308 INFO:teuthology.orchestra.run.smithi153.stdout:systemd 1404 ubuntu 21u a_inode 0,14 0 3101 [timerfd] 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:49.309 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:49.310 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:49.310 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:49.310 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-01T03:53:49.310 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-01T03:53:49.310 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-01T03:53:49.311 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:49.312 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-01T03:53:49.312 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-01T03:53:49.312 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:49.312 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.312 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.313 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.314 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.314 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.314 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.314 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-01T03:53:49.314 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-01T03:53:49.315 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-01T03:53:49.316 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-01T03:53:49.316 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.316 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.316 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:49.316 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 1u unix 0xffff9efbd02d1980 0t0 21321 type=STREAM (CONNECTED) 2023-11-01T03:53:49.317 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 2u unix 0xffff9efbd02d1980 0t0 21321 type=STREAM (CONNECTED) 2023-11-01T03:53:49.318 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 3u a_inode 0,14 0 3101 [eventfd:13] 2023-11-01T03:53:49.318 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 4u a_inode 0,14 0 3101 [eventfd:14] 2023-11-01T03:53:49.318 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 6w FIFO 0,13 0t0 21325 pipe 2023-11-01T03:53:49.318 INFO:teuthology.orchestra.run.smithi153.stdout:(sd-pam) 1414 ubuntu 7u unix 0xffff9efbd1c9b300 0t0 21341 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.319 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.319 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.319 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-01T03:53:49.319 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.319 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.320 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.321 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-01T03:53:49.321 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.321 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.321 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.322 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.322 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-01T03:53:49.322 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.322 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-01T03:53:49.322 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.323 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 4u unix 0xffff9efbd09c0000 0t0 22173 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 5w REG 8,1 1408584 1641 /var/log/messages 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 6r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 7w REG 8,1 699082 1642 /var/log/secure 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 8w REG 8,1 2201 1220 /var/log/cron 2023-11-01T03:53:49.324 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.325 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.325 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.325 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-01T03:53:49.325 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.325 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.326 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-01T03:53:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.327 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.328 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 4u unix 0xffff9efbd09c0000 0t0 22173 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.329 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 5w REG 8,1 1408584 1641 /var/log/messages 2023-11-01T03:53:49.330 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 6r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.330 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 7w REG 8,1 699082 1642 /var/log/secure 2023-11-01T03:53:49.330 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 8w REG 8,1 2201 1220 /var/log/cron 2023-11-01T03:53:49.330 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5134 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.330 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.331 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.331 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-01T03:53:49.331 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.331 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-01T03:53:49.331 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.332 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-01T03:53:49.333 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.334 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-01T03:53:49.334 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-01T03:53:49.334 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.334 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.334 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 4u unix 0xffff9efbd09c0000 0t0 22173 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 5w REG 8,1 1408584 1641 /var/log/messages 2023-11-01T03:53:49.335 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 6r a_inode 0,14 0 3101 inotify 2023-11-01T03:53:49.336 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 7w REG 8,1 699082 1642 /var/log/secure 2023-11-01T03:53:49.336 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 8w REG 8,1 2201 1220 /var/log/cron 2023-11-01T03:53:49.336 INFO:teuthology.orchestra.run.smithi153.stdout:rsyslogd 5132 5135 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-01T03:53:49.336 INFO:teuthology.orchestra.run.smithi153.stdout:tls-strp 60995 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.336 INFO:teuthology.orchestra.run.smithi153.stdout:tls-strp 60995 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:tls-strp 60995 root txt unknown /proc/60995/exe 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 68840 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 68840 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/2 68840 root txt unknown /proc/68840/exe 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 69046 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.337 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 69046 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 69046 root txt unknown /proc/69046/exe 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70295 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70295 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70295 root txt unknown /proc/70295/exe 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70415 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.338 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70415 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.339 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70415 root txt unknown /proc/70415/exe 2023-11-01T03:53:49.339 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70535 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.339 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70535 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.339 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70535 root txt unknown /proc/70535/exe 2023-11-01T03:53:49.339 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70655 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.340 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70655 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.340 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70655 root txt unknown /proc/70655/exe 2023-11-01T03:53:49.340 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70775 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.340 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70775 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.340 INFO:teuthology.orchestra.run.smithi153.stdout:kdmflush/ 70775 root txt unknown /proc/70775/exe 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfsalloc 71668 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfsalloc 71668 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfsalloc 71668 root txt unknown /proc/71668/exe 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfs_mru_c 71669 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfs_mru_c 71669 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.341 INFO:teuthology.orchestra.run.smithi153.stdout:xfs_mru_c 71669 root txt unknown /proc/71669/exe 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 71670 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 71670 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 71670 root txt unknown /proc/71670/exe 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 71671 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 71671 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.342 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 71671 root txt unknown /proc/71671/exe 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 71672 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 71672 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 71672 root txt unknown /proc/71672/exe 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 71673 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 71673 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.343 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 71673 root txt unknown /proc/71673/exe 2023-11-01T03:53:49.344 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 71674 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.344 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 71674 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.344 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 71674 root txt unknown /proc/71674/exe 2023-11-01T03:53:49.344 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 71675 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.344 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 71675 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 71675 root txt unknown /proc/71675/exe 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 71676 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 71676 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 71676 root txt unknown /proc/71676/exe 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 71677 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.345 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 71677 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.346 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 71677 root txt unknown /proc/71677/exe 2023-11-01T03:53:49.346 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.346 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.346 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-01T03:53:49.346 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.347 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-01T03:53:49.347 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-01T03:53:49.347 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.347 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.347 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-01T03:53:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-01T03:53:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-01T03:53:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-01T03:53:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-01T03:53:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-01T03:53:49.350 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-01T03:53:49.350 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-01T03:53:49.350 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:49.350 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:49.350 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.351 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-01T03:53:49.352 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.352 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.352 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.352 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.352 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-01T03:53:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.356 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.356 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.356 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.356 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.357 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 3u unix 0xffff9efbd0088000 0t0 163892 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.357 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 4u IPv4 161872 0t0 TCP smithi153.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:53120 (ESTABLISHED) 2023-11-01T03:53:49.357 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 6u unix 0xffff9efbd0086a40 0t0 163867 type=STREAM (CONNECTED) 2023-11-01T03:53:49.357 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 7w FIFO 0,24 0t0 1605 /run/systemd/sessions/4.ref 2023-11-01T03:53:49.357 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74699 root 8u unix 0xffff9efbd0081980 0t0 163896 type=STREAM (CONNECTED) 2023-11-01T03:53:49.358 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.358 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.358 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-01T03:53:49.358 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.358 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:49.359 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-01T03:53:49.360 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-01T03:53:49.361 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-01T03:53:49.362 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.363 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.364 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.364 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.364 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.364 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.364 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.365 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.366 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.366 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.366 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-01T03:53:49.366 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.366 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.367 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 3u unix 0xffff9efbd0088000 0t0 163892 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 4u IPv4 161872 0t0 TCP smithi153.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:53120 (ESTABLISHED) 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 5u unix 0xffff9efbd0083300 0t0 163895 type=STREAM (CONNECTED) 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 6u unix 0xffff9efbd0086a40 0t0 163867 type=STREAM (CONNECTED) 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 7w FIFO 0,24 0t0 1605 /run/systemd/sessions/4.ref 2023-11-01T03:53:49.368 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 12r FIFO 0,13 0t0 197410 pipe 2023-11-01T03:53:49.369 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 14r FIFO 0,13 0t0 197411 pipe 2023-11-01T03:53:49.369 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 24r FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:49.369 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 25w FIFO 0,13 0t0 181217 pipe 2023-11-01T03:53:49.369 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 26r FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:49.369 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 27r FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.370 INFO:teuthology.orchestra.run.smithi153.stdout:sshd 74702 ubuntu 29r FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.370 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.370 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.370 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-01T03:53:49.370 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.371 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.371 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.371 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.371 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-01T03:53:49.371 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.372 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.373 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.373 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.373 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.373 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.373 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 3u unix 0xffff9efbc3aeea40 0t0 150436 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.374 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 5u IPv4 150441 0t0 UDP localhost:323 2023-11-01T03:53:49.374 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 6u IPv6 150442 0t0 UDP localhost:323 2023-11-01T03:53:49.374 INFO:teuthology.orchestra.run.smithi153.stdout:chronyd 74762 chrony 7u unix 0xffff9efbc3aeee80 0t0 150443 /run/chrony/chronyd.sock type=DGRAM (UNCONNECTED) 2023-11-01T03:53:49.374 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.374 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.375 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.376 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.377 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-01T03:53:49.377 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.377 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.377 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.377 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph 1u unix 0xffff9efbd0313fc0 0t0 160600 type=STREAM (CONNECTED) 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-cras 74964 ceph 2u unix 0xffff9efbd0313fc0 0t0 160600 type=STREAM (CONNECTED) 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 79132 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 79132 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/1 79132 root txt unknown /proc/79132/exe 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 79133 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 79133 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.380 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 79133 root txt unknown /proc/79133/exe 2023-11-01T03:53:49.380 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 79369 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.380 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 79369 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.380 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 79369 root txt unknown /proc/79369/exe 2023-11-01T03:53:49.380 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 80285 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.381 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 80285 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.381 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-buf/d 80285 root txt unknown /proc/80285/exe 2023-11-01T03:53:49.381 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 80286 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.381 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 80286 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.381 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-conv/ 80286 root txt unknown /proc/80286/exe 2023-11-01T03:53:49.382 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 80287 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.382 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 80287 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.382 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-recla 80287 root txt unknown /proc/80287/exe 2023-11-01T03:53:49.382 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 80288 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.382 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 80288 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-block 80288 root txt unknown /proc/80288/exe 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 80289 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 80289 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-inode 80289 root txt unknown /proc/80289/exe 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 80290 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.383 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 80290 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.384 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-log/d 80290 root txt unknown /proc/80290/exe 2023-11-01T03:53:49.384 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 80291 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.384 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 80291 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.384 INFO:teuthology.orchestra.run.smithi153.stdout:xfs-cil/d 80291 root txt unknown /proc/80291/exe 2023-11-01T03:53:49.384 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 80292 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.385 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 80292 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.385 INFO:teuthology.orchestra.run.smithi153.stdout:xfsaild/d 80292 root txt unknown /proc/80292/exe 2023-11-01T03:53:49.385 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 83812 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.385 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 83812 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.385 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 83812 root txt unknown /proc/83812/exe 2023-11-01T03:53:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83813 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83813 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83813 root txt unknown /proc/83813/exe 2023-11-01T03:53:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83848 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.386 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83848 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/4 83848 root txt unknown /proc/83848/exe 2023-11-01T03:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:dio/dm-3 83862 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:dio/dm-3 83862 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:dio/dm-3 83862 root txt unknown /proc/83862/exe 2023-11-01T03:53:49.387 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-01T03:53:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.388 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.389 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:49.390 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:49.390 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:49.390 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-01T03:53:49.390 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-01T03:53:49.390 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.391 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.392 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.393 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.393 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.393 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.393 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.393 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-01T03:53:49.394 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.395 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.395 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.395 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.395 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-01T03:53:49.395 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.396 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.397 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.398 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.398 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.398 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.398 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 0r FIFO 0,13 0t0 181213 pipe 2023-11-01T03:53:49.399 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:49.399 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:49.399 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 3r FIFO 0,13 0t0 184487 pipe 2023-11-01T03:53:49.399 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 4w FIFO 0,13 0t0 184487 pipe 2023-11-01T03:53:49.399 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 5u netlink 0t0 184492 AUDIT 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 85991 root 6u unix 0xffff9efbd09c2ec0 0t0 184493 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:49.400 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-01T03:53:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-01T03:53:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-01T03:53:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.405 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.405 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.405 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.405 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.405 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.406 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:49.406 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-01T03:53:49.406 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:49.406 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.406 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-01T03:53:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.407 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-01T03:53:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:49.408 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:49.409 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:49.410 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:49.410 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-01T03:53:49.410 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.410 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:49.410 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 0r FIFO 0,13 0t0 181217 pipe 2023-11-01T03:53:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.411 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 3r FIFO 0,13 0t0 183595 pipe 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 4w FIFO 0,13 0t0 183595 pipe 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 5u netlink 0t0 183600 AUDIT 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 86007 root 6u unix 0xffff9efbd08eaec0 0t0 183601 type=DGRAM (CONNECTED) 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.412 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-01T03:53:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-01T03:53:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.413 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.414 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.414 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.414 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.414 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.414 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.415 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.415 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.415 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-01T03:53:49.415 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.415 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.416 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.416 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.416 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.416 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.416 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root 0r FIFO 0,13 0t0 181213 pipe 2023-11-01T03:53:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86051 root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-01T03:53:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-01T03:53:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-01T03:53:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.420 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-01T03:53:49.420 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.420 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.420 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.420 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-01T03:53:49.421 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:49.421 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.421 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:49.421 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.421 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root 0r FIFO 0,13 0t0 181217 pipe 2023-11-01T03:53:49.422 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.422 INFO:teuthology.orchestra.run.smithi153.stdout:daemon-he 86053 root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 15w REG 8,1 418032460 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86060 log root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86066 msgr-work root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86070 msgr-work root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86071 msgr-work root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86093 service root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86094 admin_soc root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86118 signal_ha root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86119 io_contex root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86120 io_contex root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86135 OpHistory root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86136 ceph_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86207 memcheck- root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86210 memcheck- root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86212 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86215 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86217 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:49.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:49.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:49.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:49.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:49.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:49.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:49.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:49.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:49.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:49.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:49.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:49.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:49.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:49.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:49.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:49.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:49.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:49.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:49.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:49.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:49.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:49.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:49.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:49.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:49.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:49.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:49.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:49.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:49.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:49.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:49.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:49.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:49.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:49.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:49.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:49.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:49.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:49.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:49.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:49.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:49.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:49.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:49.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:49.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:49.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:49.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:49.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:49.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:49.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:49.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:49.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:49.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:49.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:49.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:49.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:49.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:49.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:49.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:49.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:49.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:49.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:49.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:49.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:49.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:49.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86220 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86222 fn_anonym root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86254 rocksdb:l root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86256 rocksdb:l root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86258 rocksdb:l root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 86260 rocksdb:h root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87743 bstore_ai root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 87744 bstore_di root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88490 bstore_ai root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 88491 bstore_di root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89196 memcheck- root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89201 cfin root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89202 bstore_kv root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89203 bstore_kv root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89204 bstore_me root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89258 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89262 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89266 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89270 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89278 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89282 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89288 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89292 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89298 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89302 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89306 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89309 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89313 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89317 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89321 ms_dispat root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89323 ms_local root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89325 fn_anonym root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:50.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89327 finisher root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:50.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:50.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:50.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:50.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:50.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:50.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:50.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:50.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:50.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:50.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:50.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:50.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:50.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:50.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:50.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:50.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:50.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:50.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:50.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:50.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:50.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:50.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:50.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:50.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:50.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:50.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:50.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:50.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:50.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:50.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:50.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:50.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:50.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:50.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:50.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:50.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:50.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:50.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:50.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:50.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:50.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:50.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:50.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:50.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:50.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:50.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:50.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:50.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:50.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:50.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:50.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:50.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:50.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:50.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89329 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.036 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.037 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89331 safe_time root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.038 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.039 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.040 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.041 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.042 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.043 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.044 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.045 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.046 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.047 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.048 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.049 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.050 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.051 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.052 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.053 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.054 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.055 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.056 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.058 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.059 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.061 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.062 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.063 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.064 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.066 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89332 memcheck- root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.067 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.069 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.070 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.071 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.072 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.073 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.074 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.075 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.076 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.078 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.079 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.080 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.081 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.082 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.083 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.084 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.085 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.086 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.087 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.088 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.089 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.090 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.091 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.092 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.093 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.095 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.096 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89334 osd_srv_a root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.098 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.099 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.100 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.101 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.102 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.103 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.104 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.105 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.106 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.107 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.108 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.109 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.110 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.111 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.112 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.113 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.114 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.115 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.116 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.117 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.118 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.119 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.120 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.121 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.122 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.125 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.126 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.127 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89336 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.128 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.130 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.131 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.132 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.133 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.134 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.137 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.138 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.139 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.140 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.141 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.142 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.143 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.144 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.145 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.146 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.147 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.148 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.149 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.150 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.151 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.152 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.154 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.155 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.156 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.157 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.158 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89338 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.159 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.160 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.161 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.162 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.163 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.164 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.165 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.167 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.168 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.169 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.170 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.171 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.172 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.174 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.175 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.176 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.177 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.178 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.179 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.180 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.181 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.185 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.187 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.188 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89340 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.189 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.191 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.192 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.193 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.194 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.195 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.196 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.197 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.198 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.199 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.200 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.202 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.203 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.204 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.205 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.206 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.207 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.208 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.209 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.210 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.212 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.213 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.215 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.216 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.217 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.218 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89342 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.219 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.220 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.222 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.223 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.224 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.225 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.227 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.228 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.229 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.230 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.232 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.233 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.234 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.235 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.236 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.237 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.238 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.239 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.240 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.242 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.243 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.244 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.245 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.247 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89344 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.248 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.249 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.250 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.251 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.252 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.253 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.254 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.256 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.257 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.258 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.259 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.260 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.262 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.263 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.264 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.265 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.266 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.267 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.269 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.270 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.271 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.272 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.274 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.275 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.276 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89346 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.278 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.281 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.282 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.283 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.284 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.286 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.287 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.288 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.291 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.293 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.295 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.297 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.298 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.299 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.300 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.301 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.302 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.303 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.304 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89348 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.306 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.307 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.309 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.310 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.311 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.312 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.313 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.314 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.315 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.318 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.319 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.321 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.322 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.323 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.324 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.325 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.326 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.328 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.330 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.331 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.332 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.333 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89350 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.334 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.335 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.336 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.337 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.338 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.339 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.340 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.341 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.342 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.343 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.344 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.345 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.346 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.347 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.348 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.350 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.351 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.352 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.355 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.356 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.357 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.358 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.359 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.360 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.361 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89352 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.362 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.363 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.364 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.365 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.366 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.368 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.369 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.370 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.371 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.372 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.374 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.375 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.376 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.377 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.378 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.379 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.380 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.382 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.383 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.384 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.385 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.386 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.387 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.388 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.389 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.390 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89353 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.391 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.392 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.393 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.394 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.395 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.396 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.397 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.398 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.399 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.400 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.401 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.402 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.404 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.405 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.406 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.407 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.408 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.409 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.410 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.411 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.412 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.413 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.414 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.416 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.417 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.419 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89354 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.423 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.424 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.425 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.426 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.427 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.428 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.431 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.432 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.433 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.434 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.435 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.436 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.437 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.438 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.439 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.440 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.441 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.442 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.443 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.444 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.445 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.446 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.448 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.449 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.450 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89355 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.451 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.452 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.453 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.454 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.455 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.456 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.457 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.458 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.459 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.460 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.461 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.462 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.463 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.464 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.465 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.466 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.467 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.469 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.470 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.471 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.472 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.473 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.474 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.475 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.476 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.477 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.478 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.480 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.481 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89356 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.482 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.483 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.484 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.486 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.487 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.488 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.490 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.491 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.492 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.493 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.494 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.495 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.496 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.497 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.498 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.499 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.501 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.502 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.503 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.504 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.505 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.506 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.507 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.508 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.509 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89357 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.510 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.511 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.512 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.513 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.514 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.515 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.517 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.518 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.519 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.520 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.522 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.523 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.524 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.525 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.526 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.527 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.528 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.529 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.530 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.531 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.532 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.533 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.534 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.535 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.536 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.537 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.538 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.539 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89358 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.540 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.542 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.545 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.546 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.547 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.548 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.549 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.550 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.551 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.552 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.553 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.554 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.555 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.556 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.557 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.558 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 15w REG 8,1 418027545 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.559 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.560 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.561 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89359 tp_osd_tp root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 15752 265603 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-01T03:53:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.572 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.573 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.574 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.575 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.576 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.577 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.578 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 41304 265582 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-01T03:53:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 49912 265567 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 418096 265591 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 83208 265585 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 79224 265561 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 49744 265615 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-01T03:53:51.580 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 49856 265558 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 83632 265555 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 78744 265612 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 53880 265609 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 872944 265594 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 116592 265564 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-01T03:53:51.581 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-01T03:53:51.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 1242808 265597 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-01T03:53:51.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 62224 265576 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-01T03:53:51.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 95808 265570 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-01T03:53:51.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 37272 265606 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-01T03:53:51.582 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 104024 265588 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 133480 265552 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 834760 265579 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 129280 265600 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 83224 265573 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-01T03:53:51.583 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root mem REG 8,1 48 3092 /tmp/vgdb-pipe-shared-mem-vgdb-86057-by-root-on-??? 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root DEL REG 0,17 187432 /[aio] 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root DEL REG 0,17 187430 /[aio] 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 1w FIFO 0,13 0t0 181218 pipe 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 2w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.584 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 3w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 4r FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 5w FIFO 0,13 0t0 181977 pipe 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 6u a_inode 0,14 0 3101 [eventpoll:7,20,21,22,23,24,25,26,27] 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 7r FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 8w FIFO 0,13 0t0 181980 pipe 2023-11-01T03:53:51.585 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 9u a_inode 0,14 0 3101 [eventpoll:10,115] 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 10r FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 11w FIFO 0,13 0t0 181981 pipe 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 12u a_inode 0,14 0 3101 [eventpoll:13,116] 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 13r FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 14w FIFO 0,13 0t0 181982 pipe 2023-11-01T03:53:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 15w REG 8,1 418028105 276933 /var/log/ceph/ceph-osd.7.log 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 16uW REG 0,24 6 1957 /run/ceph/ceph-osd.7.pid 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 17r FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 18w FIFO 0,13 0t0 181984 pipe 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 19u unix 0xffff9efbd02d2640 0t0 181985 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 20u IPv4 177807 0t0 TCP *:6808 (LISTEN) 2023-11-01T03:53:51.587 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 21u IPv4 177817 0t0 TCP *:6809 (LISTEN) 2023-11-01T03:53:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 22u IPv4 177828 0t0 TCP *:6810 (LISTEN) 2023-11-01T03:53:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 23u IPv4 177840 0t0 TCP *:6811 (LISTEN) 2023-11-01T03:53:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 24u IPv4 186537 0t0 TCP *:6812 (LISTEN) 2023-11-01T03:53:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 25u IPv4 186551 0t0 TCP *:6813 (LISTEN) 2023-11-01T03:53:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 26u IPv4 186566 0t0 TCP *:6814 (LISTEN) 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 27u IPv4 186582 0t0 TCP *:6815 (LISTEN) 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 28r FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 29w FIFO 0,13 0t0 183630 pipe 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 30r FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 31w FIFO 0,13 0t0 183631 pipe 2023-11-01T03:53:51.589 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 32u sock 0,8 0t0 181993 protocol: UDPv6 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.590 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.591 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.592 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.593 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 59r FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 60w FIFO 0,13 0t0 186817 pipe 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 61r FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.594 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 63w FIFO 0,13 0t0 186818 pipe 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 115u IPv4 197177 0t0 TCP smithi153.front.sepia.ceph.com:59472->smithi153.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root 116u IPv4 197900 0t0 TCP smithi153.front.sepia.ceph.com:6808->smithi153.front.sepia.ceph.com:59472 (ESTABLISHED) 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *525u REG 8,1 32 3085 /tmp/valgrind_proc_86057_cmdline_3ad35ffa (deleted) 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *526u REG 8,1 336 3086 /tmp/valgrind_proc_86057_auxv_3ad35ffa (deleted) 2023-11-01T03:53:51.595 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *527w FIFO 0,13 0t0 181219 pipe 2023-11-01T03:53:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *528w REG 8,1 1234 393873 /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *529r FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *530w FIFO 0,13 0t0 181976 pipe 2023-11-01T03:53:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86057 89360 osd_srv_h root *531r FIFO 8,1 0t0 3094 /tmp/vgdb-pipe-from-vgdb-to-86057-by-root-on-??? 2023-11-01T03:53:51.596 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.597 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.598 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.600 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.601 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.602 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.603 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.604 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.605 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.606 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.607 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.608 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.610 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.611 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.613 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.614 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.615 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.616 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.617 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.618 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.619 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.620 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.622 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.623 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.624 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.626 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.627 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.628 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.629 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.630 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.631 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.632 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86059 log root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.633 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.634 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.635 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.636 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.637 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.638 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.639 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.640 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.641 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.642 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.643 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.644 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.645 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.646 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.648 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.649 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.650 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86063 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.654 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.656 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.657 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.658 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.659 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.660 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.661 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.663 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.664 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.665 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.666 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.667 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.668 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.669 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.670 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86065 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.671 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.672 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.673 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.675 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.676 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.677 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.678 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.679 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.680 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.681 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.682 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.683 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.684 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.685 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.686 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.687 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86068 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.689 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.690 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.691 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.692 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.693 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.695 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.696 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.697 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.698 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.699 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.700 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.701 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.703 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.704 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.705 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.706 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.707 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86091 service root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.708 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.709 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.710 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.711 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.712 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.713 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.715 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.717 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.718 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.719 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.720 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.721 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.722 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.723 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.724 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.725 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.726 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86092 admin_soc root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.727 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.728 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.730 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.731 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.732 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.734 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.735 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.736 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.737 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.738 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.739 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.740 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86115 signal_ha root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.746 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.747 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.748 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.750 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.751 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.752 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.754 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.755 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.756 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.757 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.758 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.759 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.761 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.762 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.763 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.764 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.765 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86116 io_contex root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.766 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.767 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.768 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.769 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.770 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.771 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.772 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.773 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.774 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.775 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.777 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.778 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.779 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.780 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.781 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.782 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.783 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.784 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.785 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.786 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86117 io_contex root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.787 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.788 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.789 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.790 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.791 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.792 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.793 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.794 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.795 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.796 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.799 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.800 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.801 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.802 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.803 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.804 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.805 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.806 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86134 ceph_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.807 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.808 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.809 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.810 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.812 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.813 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.814 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.815 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.816 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.817 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.818 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.819 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.820 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.821 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.822 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.823 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.824 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.825 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.826 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86205 memcheck- root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.827 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.828 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.829 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.831 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.832 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.833 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.834 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.835 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.836 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.837 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.838 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.840 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.841 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.842 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.843 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.844 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.845 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86208 memcheck- root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.846 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.847 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.848 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.849 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.850 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.853 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.854 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.855 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.856 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.857 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.858 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.859 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.860 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.861 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.862 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.863 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.864 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.865 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86253 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.866 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.867 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.868 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.869 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.870 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.872 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.874 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.875 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.876 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.878 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.881 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.882 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.883 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.884 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86255 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.885 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.886 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.887 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.888 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.889 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.890 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.891 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.892 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.893 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.894 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.895 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.896 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.898 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.899 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.900 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.901 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.902 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.903 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86257 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.904 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.906 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.907 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.908 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.909 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.910 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.911 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.912 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.913 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.915 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.916 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.917 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.918 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.920 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.921 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 86259 rocksdb:h root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.924 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.925 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.926 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.928 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.929 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.930 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.931 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.932 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.933 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.934 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.935 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.936 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.937 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.938 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.939 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.940 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89209 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.941 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.942 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.944 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.946 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.947 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.948 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.950 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.951 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.952 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.953 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.954 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.955 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.956 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.957 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.958 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89210 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.959 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.960 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.961 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.962 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.963 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.964 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.965 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.966 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.967 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.968 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.969 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.970 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.971 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.972 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.973 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.974 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.975 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.976 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.977 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89221 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.978 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.979 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:51.981 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:51.982 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:51.983 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:51.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:51.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:51.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:51.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:51.984 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:51.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:51.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:51.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:51.986 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:51.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:51.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:51.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:51.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:51.987 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:51.988 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:51.990 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:51.991 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:51.992 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:51.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:51.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:51.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:51.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.993 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:51.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:51.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:51.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.994 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:51.995 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:51.996 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89223 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:51.997 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:51.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:51.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:51.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:51.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:51.998 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:51.999 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:52.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:52.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:52.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:52.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:52.000 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:52.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:52.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:52.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:52.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:52.001 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:52.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:52.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:52.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:52.002 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:52.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:52.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:52.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:52.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:52.004 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:52.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:52.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:52.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:52.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:52.006 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:52.008 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:52.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:52.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:52.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:52.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:52.009 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:52.010 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:52.011 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:52.012 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:52.013 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:52.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:52.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:52.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:52.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:52.014 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89225 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2023-11-01T03:53:52.015 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-01T03:53:52.016 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-01T03:53:52.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-01T03:53:52.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-01T03:53:52.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-01T03:53:52.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-01T03:53:52.017 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-01T03:53:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-01T03:53:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-01T03:53:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:52.018 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:52.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:52.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-01T03:53:52.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-01T03:53:52.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-01T03:53:52.019 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-01T03:53:52.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:52.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:52.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-01T03:53:52.020 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:52.021 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-01T03:53:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-01T03:53:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-01T03:53:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-01T03:53:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:52.023 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-01T03:53:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:52.024 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-01T03:53:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-01T03:53:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 83456 265548 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-01T03:53:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 370416 265538 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-01T03:53:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 1481856 265542 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-01T03:53:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 45648 265523 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-01T03:53:52.026 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root mem REG 8,1 48 3082 /tmp/vgdb-pipe-shared-mem-vgdb-86058-by-root-on-??? 2023-11-01T03:53:52.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-01T03:53:52.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 1w FIFO 0,13 0t0 181214 pipe 2023-11-01T03:53:52.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 2w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:52.027 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 3w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:52.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 4r FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:52.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 5w FIFO 0,13 0t0 184515 pipe 2023-11-01T03:53:52.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 6u a_inode 0,14 0 3101 [eventpoll:7,26,27] 2023-11-01T03:53:52.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 7r FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:52.028 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 8w FIFO 0,13 0t0 177743 pipe 2023-11-01T03:53:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 9u a_inode 0,14 0 3101 [eventpoll:10,64] 2023-11-01T03:53:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 10r FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 11w FIFO 0,13 0t0 177744 pipe 2023-11-01T03:53:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 12u a_inode 0,14 0 3101 [eventpoll:13] 2023-11-01T03:53:52.029 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 13r FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 14w FIFO 0,13 0t0 177745 pipe 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 15w REG 8,1 437426189 276932 /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 16uW REG 0,24 6 1955 /run/ceph/ceph-osd.6.pid 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 17r FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 18w FIFO 0,13 0t0 187402 pipe 2023-11-01T03:53:52.030 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 19u unix 0xffff9efbd0084400 0t0 187403 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2023-11-01T03:53:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 20u IPv4 196393 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:53310 (CLOSE_WAIT) 2023-11-01T03:53:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 26u IPv4 177790 0t0 TCP *:6806 (LISTEN) 2023-11-01T03:53:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 27u IPv4 177798 0t0 TCP *:6807 (LISTEN) 2023-11-01T03:53:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 28r FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:52.031 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 29w FIFO 0,13 0t0 187410 pipe 2023-11-01T03:53:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 30r FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 31w FIFO 0,13 0t0 187411 pipe 2023-11-01T03:53:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 32u sock 0,8 0t0 177874 protocol: UDPv6 2023-11-01T03:53:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 60r FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 61w FIFO 0,13 0t0 177898 pipe 2023-11-01T03:53:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 62r FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 63w FIFO 0,13 0t0 177899 pipe 2023-11-01T03:53:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root 64u IPv4 199003 0t0 TCP smithi153.front.sepia.ceph.com:6806->smithi153.front.sepia.ceph.com:59686 (CLOSE_WAIT) 2023-11-01T03:53:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-01T03:53:52.033 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86058_cmdline_43e39d20 (deleted) 2023-11-01T03:53:52.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86058_auxv_43e39d20 (deleted) 2023-11-01T03:53:52.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *527w FIFO 0,13 0t0 181215 pipe 2023-11-01T03:53:52.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *528w REG 8,1 1234 393874 /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:52.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *529r FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:52.034 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *530w FIFO 0,13 0t0 184514 pipe 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:memcheck- 86058 89227 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86058-by-root-on-??? 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 89383 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 89383 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/3 89383 root txt unknown /proc/89383/exe 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89387 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.035 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89387 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89387 root txt unknown /proc/89387/exe 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89391 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89391 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89391 root txt unknown /proc/89391/exe 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89393 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.036 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89393 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.037 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89393 root txt unknown /proc/89393/exe 2023-11-01T03:53:52.037 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89395 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.037 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89395 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.037 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89395 root txt unknown /proc/89395/exe 2023-11-01T03:53:52.037 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89397 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.038 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89397 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.038 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/7 89397 root txt unknown /proc/89397/exe 2023-11-01T03:53:52.038 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89399 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.038 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89399 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/5 89399 root txt unknown /proc/89399/exe 2023-11-01T03:53:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 89400 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 89400 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/6 89400 root txt unknown /proc/89400/exe 2023-11-01T03:53:52.039 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89403 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89403 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/u 89403 root txt unknown /proc/89403/exe 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 89405 root cwd DIR 8,1 4096 2 / 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 89405 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:kworker/0 89405 root txt unknown /proc/89405/exe 2023-11-01T03:53:52.040 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:52.041 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:52.042 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:52.043 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu 0r FIFO 0,13 0t0 197409 pipe 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu 1w FIFO 0,13 0t0 197410 pipe 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:bash 89482 ubuntu 2w FIFO 0,13 0t0 197411 pipe 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-01T03:53:52.044 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-01T03:53:52.045 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-01T03:53:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-01T03:53:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-01T03:53:52.046 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-01T03:53:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-01T03:53:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-01T03:53:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-01T03:53:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-01T03:53:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-01T03:53:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-01T03:53:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-01T03:53:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-01T03:53:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-01T03:53:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-01T03:53:52.050 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-01T03:53:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-01T03:53:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-01T03:53:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-01T03:53:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-01T03:53:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-01T03:53:52.052 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-01T03:53:52.053 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-01T03:53:52.053 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-01T03:53:52.053 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-01T03:53:52.053 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-01T03:53:52.053 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:52.054 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-01T03:53:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-01T03:53:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 0r FIFO 0,13 0t0 197409 pipe 2023-11-01T03:53:52.055 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 1w FIFO 0,13 0t0 197410 pipe 2023-11-01T03:53:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 2w FIFO 0,13 0t0 197411 pipe 2023-11-01T03:53:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 3r FIFO 0,13 0t0 201978 pipe 2023-11-01T03:53:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 4w FIFO 0,13 0t0 201978 pipe 2023-11-01T03:53:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 5u netlink 0t0 201984 AUDIT 2023-11-01T03:53:52.056 INFO:teuthology.orchestra.run.smithi153.stdout:sudo 89498 root 6u unix 0xffff9efbd09c0880 0t0 201985 type=DGRAM (CONNECTED) 2023-11-01T03:53:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-01T03:53:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-01T03:53:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:52.058 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:52.059 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:52.060 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-01T03:53:52.060 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:52.060 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:52.060 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:52.060 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 0r FIFO 0,13 0t0 197409 pipe 2023-11-01T03:53:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 1w FIFO 0,13 0t0 197410 pipe 2023-11-01T03:53:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 2w FIFO 0,13 0t0 197411 pipe 2023-11-01T03:53:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 3r DIR 0,20 0 1 /proc 2023-11-01T03:53:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 4r DIR 0,20 0 199068 /proc/89500/fd 2023-11-01T03:53:52.061 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 5w FIFO 0,13 0t0 199073 pipe 2023-11-01T03:53:52.062 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89500 root 6r FIFO 0,13 0t0 199074 pipe 2023-11-01T03:53:52.062 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-01T03:53:52.062 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root rtd DIR 8,1 4096 2 / 2023-11-01T03:53:52.062 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-01T03:53:52.063 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-01T03:53:52.063 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-01T03:53:52.063 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-01T03:53:52.063 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-01T03:53:52.063 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-01T03:53:52.064 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-01T03:53:52.064 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-01T03:53:52.064 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-01T03:53:52.064 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-01T03:53:52.064 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-01T03:53:52.065 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-01T03:53:52.065 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-01T03:53:52.065 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-01T03:53:52.065 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-01T03:53:52.065 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-01T03:53:52.066 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-01T03:53:52.066 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root 4r FIFO 0,13 0t0 199073 pipe 2023-11-01T03:53:52.066 INFO:teuthology.orchestra.run.smithi153.stdout:lsof 89501 root 7w FIFO 0,13 0t0 199074 pipe 2023-11-01T03:53:52.066 INFO:teuthology.orchestra.run.smithi153.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-01T03:53:52.066 INFO:teuthology.orchestra.run.smithi153.stdout:root 2 0.0 0.0 0 0 ? S 03:00 0:00 [kthreadd] 2023-11-01T03:53:52.067 INFO:teuthology.orchestra.run.smithi153.stdout:root 3 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [rcu_gp] 2023-11-01T03:53:52.067 INFO:teuthology.orchestra.run.smithi153.stdout:root 4 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [rcu_par_gp] 2023-11-01T03:53:52.067 INFO:teuthology.orchestra.run.smithi153.stdout:root 5 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [slub_flushwq] 2023-11-01T03:53:52.067 INFO:teuthology.orchestra.run.smithi153.stdout:root 6 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [netns] 2023-11-01T03:53:52.067 INFO:teuthology.orchestra.run.smithi153.stdout:root 8 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-01T03:53:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:root 11 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [mm_percpu_wq] 2023-11-01T03:53:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:root 13 0.0 0.0 0 0 ? I 03:00 0:00 \_ [rcu_tasks_kthre] 2023-11-01T03:53:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:root 14 0.0 0.0 0 0 ? I 03:00 0:00 \_ [rcu_tasks_rude_] 2023-11-01T03:53:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:root 15 0.0 0.0 0 0 ? I 03:00 0:00 \_ [rcu_tasks_trace] 2023-11-01T03:53:52.068 INFO:teuthology.orchestra.run.smithi153.stdout:root 16 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/0] 2023-11-01T03:53:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:root 17 0.1 0.0 0 0 ? S 03:00 0:04 \_ [pr/ttyS1] 2023-11-01T03:53:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:root 18 0.0 0.0 0 0 ? I 03:00 0:00 \_ [rcu_preempt] 2023-11-01T03:53:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:root 19 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/0] 2023-11-01T03:53:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:root 20 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/0] 2023-11-01T03:53:52.069 INFO:teuthology.orchestra.run.smithi153.stdout:root 21 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/0] 2023-11-01T03:53:52.070 INFO:teuthology.orchestra.run.smithi153.stdout:root 22 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/1] 2023-11-01T03:53:52.070 INFO:teuthology.orchestra.run.smithi153.stdout:root 23 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/1] 2023-11-01T03:53:52.070 INFO:teuthology.orchestra.run.smithi153.stdout:root 24 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/1] 2023-11-01T03:53:52.070 INFO:teuthology.orchestra.run.smithi153.stdout:root 25 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/1] 2023-11-01T03:53:52.070 INFO:teuthology.orchestra.run.smithi153.stdout:root 27 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 28 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/2] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 29 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/2] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 30 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/2] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 31 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/2] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 33 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-01T03:53:52.071 INFO:teuthology.orchestra.run.smithi153.stdout:root 34 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/3] 2023-11-01T03:53:52.072 INFO:teuthology.orchestra.run.smithi153.stdout:root 35 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/3] 2023-11-01T03:53:52.072 INFO:teuthology.orchestra.run.smithi153.stdout:root 36 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/3] 2023-11-01T03:53:52.072 INFO:teuthology.orchestra.run.smithi153.stdout:root 37 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/3] 2023-11-01T03:53:52.072 INFO:teuthology.orchestra.run.smithi153.stdout:root 39 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-01T03:53:52.072 INFO:teuthology.orchestra.run.smithi153.stdout:root 40 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/4] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 41 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/4] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 42 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/4] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 43 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/4] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 45 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 46 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/5] 2023-11-01T03:53:52.073 INFO:teuthology.orchestra.run.smithi153.stdout:root 47 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/5] 2023-11-01T03:53:52.074 INFO:teuthology.orchestra.run.smithi153.stdout:root 48 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/5] 2023-11-01T03:53:52.074 INFO:teuthology.orchestra.run.smithi153.stdout:root 49 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/5] 2023-11-01T03:53:52.074 INFO:teuthology.orchestra.run.smithi153.stdout:root 51 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-01T03:53:52.074 INFO:teuthology.orchestra.run.smithi153.stdout:root 52 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/6] 2023-11-01T03:53:52.074 INFO:teuthology.orchestra.run.smithi153.stdout:root 53 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/6] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 54 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/6] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 55 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/6] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 57 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 58 0.0 0.0 0 0 ? S 03:00 0:00 \_ [cpuhp/7] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 59 0.0 0.0 0 0 ? S 03:00 0:00 \_ [idle_inject/7] 2023-11-01T03:53:52.075 INFO:teuthology.orchestra.run.smithi153.stdout:root 60 0.0 0.0 0 0 ? S 03:00 0:00 \_ [migration/7] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 61 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ksoftirqd/7] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 63 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 68 0.0 0.0 0 0 ? I 03:00 0:00 \_ [kworker/u16:5-flush-8:0] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 70 0.0 0.0 0 0 ? I 03:00 0:00 \_ [kworker/u16:7-events_unbound] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 71 0.0 0.0 0 0 ? S 03:00 0:00 \_ [kdevtmpfs] 2023-11-01T03:53:52.076 INFO:teuthology.orchestra.run.smithi153.stdout:root 72 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [inet_frag_wq] 2023-11-01T03:53:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:root 73 0.0 0.0 0 0 ? S 03:00 0:00 \_ [kauditd] 2023-11-01T03:53:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:root 75 0.0 0.0 0 0 ? S 03:00 0:00 \_ [khungtaskd] 2023-11-01T03:53:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:root 76 0.0 0.0 0 0 ? S 03:00 0:00 \_ [oom_reaper] 2023-11-01T03:53:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:root 77 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [writeback] 2023-11-01T03:53:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:root 78 0.0 0.0 0 0 ? S 03:00 0:00 \_ [kcompactd0] 2023-11-01T03:53:52.078 INFO:teuthology.orchestra.run.smithi153.stdout:root 79 0.0 0.0 0 0 ? SN 03:00 0:00 \_ [ksmd] 2023-11-01T03:53:52.078 INFO:teuthology.orchestra.run.smithi153.stdout:root 80 0.0 0.0 0 0 ? SN 03:00 0:00 \_ [khugepaged] 2023-11-01T03:53:52.078 INFO:teuthology.orchestra.run.smithi153.stdout:root 81 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [cryptd] 2023-11-01T03:53:52.078 INFO:teuthology.orchestra.run.smithi153.stdout:root 82 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kintegrityd] 2023-11-01T03:53:52.078 INFO:teuthology.orchestra.run.smithi153.stdout:root 83 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kblockd] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 84 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [blkcg_punt_bio] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 86 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [tpm_dev_wq] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 87 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [md] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 88 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [md_bitmap] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 89 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [edac-poller] 2023-11-01T03:53:52.079 INFO:teuthology.orchestra.run.smithi153.stdout:root 90 0.0 0.0 0 0 ? S 03:00 0:00 \_ [watchdogd] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 91 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/0:1H-xfs-log/dm-2] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 92 0.0 0.0 0 0 ? I 03:00 0:00 \_ [kworker/1:1-events] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 93 0.0 0.0 0 0 ? S 03:00 0:00 \_ [kswapd0] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 100 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kthrotld] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 108 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [acpi_thermal_pm] 2023-11-01T03:53:52.080 INFO:teuthology.orchestra.run.smithi153.stdout:root 109 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kmpath_rdacd] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 110 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kaluad] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 112 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [mld] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 113 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/7:1H-xfs-log/dm-0] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 114 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [ipv6_addrconf] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 123 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kstrp] 2023-11-01T03:53:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:root 129 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [zswap-shrink] 2023-11-01T03:53:52.082 INFO:teuthology.orchestra.run.smithi153.stdout:root 237 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/u17:0] 2023-11-01T03:53:52.082 INFO:teuthology.orchestra.run.smithi153.stdout:root 276 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/2:1H-kblockd] 2023-11-01T03:53:52.082 INFO:teuthology.orchestra.run.smithi153.stdout:root 279 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/1:1H-xfs-log/dm-1] 2023-11-01T03:53:52.082 INFO:teuthology.orchestra.run.smithi153.stdout:root 283 0.1 0.0 0 0 ? I 03:00 0:03 \_ [kworker/3:2-events] 2023-11-01T03:53:52.082 INFO:teuthology.orchestra.run.smithi153.stdout:root 291 0.0 0.0 0 0 ? I 03:00 0:00 \_ [kworker/2:2-events] 2023-11-01T03:53:52.083 INFO:teuthology.orchestra.run.smithi153.stdout:root 323 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/4:1H-kblockd] 2023-11-01T03:53:52.083 INFO:teuthology.orchestra.run.smithi153.stdout:root 352 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/3:1H-kblockd] 2023-11-01T03:53:52.083 INFO:teuthology.orchestra.run.smithi153.stdout:root 376 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/6:1H-kblockd] 2023-11-01T03:53:52.083 INFO:teuthology.orchestra.run.smithi153.stdout:root 425 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [ata_sff] 2023-11-01T03:53:52.083 INFO:teuthology.orchestra.run.smithi153.stdout:root 428 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [nvme-wq] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 431 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [nvme-reset-wq] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 432 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [nvme-delete-wq] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 433 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [nvme-auth-wq] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 443 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_0] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 444 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_0] 2023-11-01T03:53:52.084 INFO:teuthology.orchestra.run.smithi153.stdout:root 445 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_1] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 446 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_1] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 447 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_2] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 448 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_2] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 449 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_3] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 450 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_3] 2023-11-01T03:53:52.085 INFO:teuthology.orchestra.run.smithi153.stdout:root 452 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [ixgbe] 2023-11-01T03:53:52.086 INFO:teuthology.orchestra.run.smithi153.stdout:root 453 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_4] 2023-11-01T03:53:52.086 INFO:teuthology.orchestra.run.smithi153.stdout:root 454 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_4] 2023-11-01T03:53:52.086 INFO:teuthology.orchestra.run.smithi153.stdout:root 455 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_5] 2023-11-01T03:53:52.086 INFO:teuthology.orchestra.run.smithi153.stdout:root 456 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_5] 2023-11-01T03:53:52.086 INFO:teuthology.orchestra.run.smithi153.stdout:root 457 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_6] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 458 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_6] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 459 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_7] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 460 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_7] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 461 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_8] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 462 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_8] 2023-11-01T03:53:52.087 INFO:teuthology.orchestra.run.smithi153.stdout:root 463 0.0 0.0 0 0 ? S 03:00 0:00 \_ [scsi_eh_9] 2023-11-01T03:53:52.088 INFO:teuthology.orchestra.run.smithi153.stdout:root 464 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [scsi_tmf_9] 2023-11-01T03:53:52.088 INFO:teuthology.orchestra.run.smithi153.stdout:root 471 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [kworker/5:1H-kblockd] 2023-11-01T03:53:52.088 INFO:teuthology.orchestra.run.smithi153.stdout:root 478 0.0 0.0 0 0 ? I 03:00 0:00 \_ [kworker/0:2-events] 2023-11-01T03:53:52.088 INFO:teuthology.orchestra.run.smithi153.stdout:root 489 0.0 0.0 0 0 ? S 03:00 0:00 \_ [jbd2/sda1-8] 2023-11-01T03:53:52.088 INFO:teuthology.orchestra.run.smithi153.stdout:root 490 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [ext4-rsv-conver] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 571 0.0 0.0 0 0 ? S 03:00 0:00 \_ [ext4lazyinit] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 633 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [ipmi-msghandler] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 648 0.0 0.0 0 0 ? SN 03:00 0:00 \_ [kipmi0] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 659 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [rpciod] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 660 0.0 0.0 0 0 ? I< 03:00 0:00 \_ [xprtiod] 2023-11-01T03:53:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:root 60995 0.0 0.0 0 0 ? I< 03:04 0:00 \_ [tls-strp] 2023-11-01T03:53:52.090 INFO:teuthology.orchestra.run.smithi153.stdout:root 68840 0.0 0.0 0 0 ? I 03:06 0:00 \_ [kworker/2:0-inode_switch_wbs] 2023-11-01T03:53:52.090 INFO:teuthology.orchestra.run.smithi153.stdout:root 69046 0.0 0.0 0 0 ? I 03:06 0:00 \_ [kworker/5:2-mm_percpu_wq] 2023-11-01T03:53:52.090 INFO:teuthology.orchestra.run.smithi153.stdout:root 70295 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [kdmflush/253:0] 2023-11-01T03:53:52.090 INFO:teuthology.orchestra.run.smithi153.stdout:root 70415 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [kdmflush/253:1] 2023-11-01T03:53:52.090 INFO:teuthology.orchestra.run.smithi153.stdout:root 70535 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [kdmflush/253:2] 2023-11-01T03:53:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:root 70655 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [kdmflush/253:3] 2023-11-01T03:53:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:root 70775 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [kdmflush/253:4] 2023-11-01T03:53:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:root 71668 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfsalloc] 2023-11-01T03:53:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:root 71669 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs_mru_cache] 2023-11-01T03:53:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:root 71670 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-buf/dm-4] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71671 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-conv/dm-4] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71672 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-reclaim/dm-] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71673 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-blockgc/dm-] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71674 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-inodegc/dm-] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71675 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-log/dm-4] 2023-11-01T03:53:52.092 INFO:teuthology.orchestra.run.smithi153.stdout:root 71676 0.0 0.0 0 0 ? I< 03:06 0:00 \_ [xfs-cil/dm-4] 2023-11-01T03:53:52.093 INFO:teuthology.orchestra.run.smithi153.stdout:root 71677 0.0 0.0 0 0 ? S 03:06 0:00 \_ [xfsaild/dm-4] 2023-11-01T03:53:52.093 INFO:teuthology.orchestra.run.smithi153.stdout:root 79132 0.0 0.0 0 0 ? I 03:15 0:00 \_ [kworker/1:0] 2023-11-01T03:53:52.093 INFO:teuthology.orchestra.run.smithi153.stdout:root 79133 0.0 0.0 0 0 ? I 03:15 0:00 \_ [kworker/0:0-cgroup_destroy] 2023-11-01T03:53:52.093 INFO:teuthology.orchestra.run.smithi153.stdout:root 79369 0.0 0.0 0 0 ? I 03:17 0:00 \_ [kworker/u16:4-flush-8:0] 2023-11-01T03:53:52.093 INFO:teuthology.orchestra.run.smithi153.stdout:root 80285 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-buf/dm-3] 2023-11-01T03:53:52.094 INFO:teuthology.orchestra.run.smithi153.stdout:root 80286 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-conv/dm-3] 2023-11-01T03:53:52.094 INFO:teuthology.orchestra.run.smithi153.stdout:root 80287 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-reclaim/dm-] 2023-11-01T03:53:52.094 INFO:teuthology.orchestra.run.smithi153.stdout:root 80288 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-blockgc/dm-] 2023-11-01T03:53:52.094 INFO:teuthology.orchestra.run.smithi153.stdout:root 80289 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-inodegc/dm-] 2023-11-01T03:53:52.094 INFO:teuthology.orchestra.run.smithi153.stdout:root 80290 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-log/dm-3] 2023-11-01T03:53:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:root 80291 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [xfs-cil/dm-3] 2023-11-01T03:53:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:root 80292 0.0 0.0 0 0 ? S 03:17 0:00 \_ [xfsaild/dm-3] 2023-11-01T03:53:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:root 83812 0.0 0.0 0 0 ? I 03:17 0:00 \_ [kworker/6:0-mm_percpu_wq] 2023-11-01T03:53:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:root 83813 0.0 0.0 0 0 ? I 03:17 0:00 \_ [kworker/4:0-events] 2023-11-01T03:53:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:root 83848 0.0 0.0 0 0 ? I 03:17 0:00 \_ [kworker/4:1] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 83862 0.0 0.0 0 0 ? I< 03:17 0:00 \_ [dio/dm-3] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 89383 0.0 0.0 0 0 ? I 03:20 0:00 \_ [kworker/3:1] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 89387 0.0 0.0 0 0 ? I 03:28 0:00 \_ [kworker/u16:2-flush-8:0] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 89391 0.0 0.0 0 0 ? I 03:32 0:00 \_ [kworker/5:0-mm_percpu_wq] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 89393 0.0 0.0 0 0 ? I 03:35 0:00 \_ [kworker/7:0-cgroup_destroy] 2023-11-01T03:53:52.096 INFO:teuthology.orchestra.run.smithi153.stdout:root 89395 0.0 0.0 0 0 ? I 03:40 0:00 \_ [kworker/u16:1-flush-8:0] 2023-11-01T03:53:52.097 INFO:teuthology.orchestra.run.smithi153.stdout:root 89397 0.0 0.0 0 0 ? I 03:42 0:00 \_ [kworker/7:1-mm_percpu_wq] 2023-11-01T03:53:52.097 INFO:teuthology.orchestra.run.smithi153.stdout:root 89399 0.0 0.0 0 0 ? I 03:44 0:00 \_ [kworker/5:1-events] 2023-11-01T03:53:52.097 INFO:teuthology.orchestra.run.smithi153.stdout:root 89400 0.0 0.0 0 0 ? I 03:47 0:00 \_ [kworker/6:2-events_freezable] 2023-11-01T03:53:52.097 INFO:teuthology.orchestra.run.smithi153.stdout:root 89403 0.0 0.0 0 0 ? I 03:49 0:00 \_ [kworker/u16:0-events_unbound] 2023-11-01T03:53:52.097 INFO:teuthology.orchestra.run.smithi153.stdout:root 89405 0.0 0.0 0 0 ? I 03:50 0:00 \_ [kworker/0:1-events] 2023-11-01T03:53:52.098 INFO:teuthology.orchestra.run.smithi153.stdout:root 1 0.1 0.0 175988 20344 ? Ss 03:00 0:03 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-01T03:53:52.098 INFO:teuthology.orchestra.run.smithi153.stdout:root 565 0.0 0.0 26664 15684 ? Ss 03:00 0:00 /usr/lib/systemd/systemd-journald 2023-11-01T03:53:52.098 INFO:teuthology.orchestra.run.smithi153.stdout:root 580 0.0 0.0 37576 15904 ? Ss 03:00 0:00 /usr/lib/systemd/systemd-udevd 2023-11-01T03:53:52.098 INFO:teuthology.orchestra.run.smithi153.stdout:rpc 655 0.0 0.0 13244 5732 ? Ss 03:00 0:00 /usr/bin/rpcbind -w -f 2023-11-01T03:53:52.098 INFO:teuthology.orchestra.run.smithi153.stdout:root 661 0.0 0.0 91824 4484 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-01T03:53:52.107 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:49.835+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:52.108 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:50.848+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:52.108 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:51.842+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:52.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-01T03:53:52.151 INFO:teuthology.orchestra.run.smithi153.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-11-01T03:53:52.160 INFO:teuthology.orchestra.run.smithi005.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-11-01T03:53:52.160 INFO:teuthology.orchestra.run.smithi005.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-11-01T03:53:52.161 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-11-01T03:53:52.162 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-11-01T03:53:52.162 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-11-01T03:53:52.162 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-11-01T03:53:52.163 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-11-01T03:53:52.163 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-11-01T03:53:52.164 INFO:tasks.ceph:Archiving crash dumps... 2023-11-01T03:53:52.166 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi005/crash 2023-11-01T03:53:52.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-01T03:53:52.217 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi153/crash 2023-11-01T03:53:52.218 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-01T03:53:52.263 INFO:tasks.ceph:Compressing logs... 2023-11-01T03:53:52.264 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-01T03:53:52.266 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-01T03:53:52.296 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85916.log 2023-11-01T03:53:52.296 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-01T03:53:52.296 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85956.log 2023-11-01T03:53:52.297 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2023-11-01T03:53:52.297 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85916.log.gz 2023-11-01T03:53:52.297 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85956.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2023-11-01T03:53:52.297 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/osd.7.log: 55.1%gzip -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2023-11-01T03:53:52.297 INFO:teuthology.orchestra.run.smithi153.stderr: -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2023-11-01T03:53:52.298 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.85956.log.gz 2023-11-01T03:53:52.298 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-11-01T03:53:52.298 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/osd.5.log: /var/log/ceph/valgrind/osd.6.log: 63.9% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2023-11-01T03:53:52.298 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2023-11-01T03:53:52.298 INFO:teuthology.orchestra.run.smithi153.stderr: 55.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85745.log 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85665.log 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85745.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-01T03:53:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85665.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-01T03:53:52.300 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85745.log.gz 2023-11-01T03:53:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log/var/log/ceph/ceph.audit.log: 2023-11-01T03:53:52.300 INFO:teuthology.orchestra.run.smithi153.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85665.log.gz 2023-11-01T03:53:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-01T03:53:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85785.log 2023-11-01T03:53:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85865.log 2023-11-01T03:53:52.309 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85785.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-01T03:53:52.309 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85865.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85785.log.gz 2023-11-01T03:53:52.309 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85865.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-01T03:53:52.309 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:53:52.309 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85825.log 2023-11-01T03:53:52.310 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: 92.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-01T03:53:52.310 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-01T03:53:52.310 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85825.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85825.log.gz 2023-11-01T03:53:52.310 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85705.log 2023-11-01T03:53:52.310 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: 88.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-01T03:53:52.311 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85705.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85705.log.gz 2023-11-01T03:53:52.327 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-01T03:53:52.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158343.log 2023-11-01T03:53:52.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90502.log 2023-11-01T03:53:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.158343.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.92046.log 2023-11-01T03:53:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90502.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-01T03:53:52.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158343.log.gz 2023-11-01T03:53:52.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157965.log 2023-11-01T03:53:52.351 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90502.log.gz 2023-11-01T03:53:52.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125654.log 2023-11-01T03:53:52.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125652.log 2023-11-01T03:53:52.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157965.log.gz 2023-11-01T03:53:52.352 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91615.log 2023-11-01T03:53:52.352 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92286.log 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125652.log: /var/log/ceph/ceph-client.admin.91615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91946.log 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90840.log 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158427.log 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90840.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90840.log.gz 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125652.log.gz 2023-11-01T03:53:52.353 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.90834.log 90.5% -- replaced with /var/log/ceph/ceph-client.admin.125654.log.gz 2023-11-01T03:53:52.354 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.354 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.158427.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.157671.log 2023-11-01T03:53:52.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90834.log: gzip 87.0% -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-11-01T03:53:52.354 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158427.log.gz 2023-11-01T03:53:52.354 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90834.log.gz 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157671.log: /var/log/ceph/valgrind/mon.c.log: 74.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.157671.log.gz 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- 64.0% /var/log/ceph/valgrind/osd.1.log 2023-11-01T03:53:52.355 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2023-11-01T03:53:52.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/valgrind/osd.0.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.92046.log.gz 2023-11-01T03:53:52.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-11-01T03:53:52.356 INFO:teuthology.orchestra.run.smithi005.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2023-11-01T03:53:52.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2023-11-01T03:53:52.356 INFO:teuthology.orchestra.run.smithi005.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90829.log 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr: 74.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92386.log 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/valgrind/mon.a.log.gz/var/log/ceph/valgrind/osd.3.log: 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90495.log 2023-11-01T03:53:52.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92386.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90829.log.gz 2023-11-01T03:53:52.358 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.86620.log 2023-11-01T03:53:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92434.log 2023-11-01T03:53:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86620.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.91946.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90495.log.gz 2023-11-01T03:53:52.358 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157713.log 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.92434.log: -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86620.log.gz 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.90024.log 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115390.log 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90024.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157713.log.gzgzip 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.115387.log 2023-11-01T03:53:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90024.log.gz 2023-11-01T03:53:52.360 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.88319.log 2023-11-01T03:53:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115387.log: /var/log/ceph/ceph-client.admin.115390.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80259.log 2023-11-01T03:53:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88319.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115387.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92386.log.gz 2023-11-01T03:53:52.360 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88319.log.gz 2023-11-01T03:53:52.361 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.158385.log 2023-11-01T03:53:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.80259.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80259.log.gz 2023-11-01T03:53:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92166.log 2023-11-01T03:53:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91076.log 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158385.log.gzgzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92434.log.gz -5 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.157755.log 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92166.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.115390.log.gz 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91640.log 2023-11-01T03:53:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157755.log: gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91076.log.gz 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90276.log 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92435.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157755.log.gz 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157587.log 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90276.log.gz 2023-11-01T03:53:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125651.log 2023-11-01T03:53:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86515.log 2023-11-01T03:53:52.364 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.92435.log.gz 2023-11-01T03:53:52.364 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157587.log.gz 2023-11-01T03:53:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158007.log 2023-11-01T03:53:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91246.log 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158007.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86515.log.gz 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91246.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158007.log.gz 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158175.log 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91246.log.gz/var/log/ceph/ceph.audit.log: 2023-11-01T03:53:52.365 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.125651.log.gz 2023-11-01T03:53:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90186.log 2023-11-01T03:53:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107947.log 2023-11-01T03:53:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90186.log: 87.8% 91.3% -- replaced with /var/log/ceph/ceph-client.admin.92166.log.gz 2023-11-01T03:53:52.366 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158175.log.gz 2023-11-01T03:53:52.366 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136072.log 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90186.log.gz/var/log/ceph/ceph-client.admin.107947.log: 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92388.log 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.136072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115389.log 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92388.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.107947.log.gz 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158259.log 2023-11-01T03:53:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115389.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.136072.log.gz 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.92388.log.gz 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157839.log 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158259.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115389.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92019.log 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158259.log.gz 2023-11-01T03:53:52.368 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.158511.log 2023-11-01T03:53:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157839.log: /var/log/ceph/ceph-client.admin.92019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92416.log 2023-11-01T03:53:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158511.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157839.log.gz 2023-11-01T03:53:52.369 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.158511.log.gz 2023-11-01T03:53:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90490.log 2023-11-01T03:53:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87341.log 2023-11-01T03:53:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90490.log: /var/log/ceph/ceph-client.admin.92416.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90490.log.gz 2023-11-01T03:53:52.370 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.92416.log.gz 2023-11-01T03:53:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91036.log 2023-11-01T03:53:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90138.log 2023-11-01T03:53:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91036.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87341.log.gz 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.92019.log.gz 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91036.log.gz 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157629.log 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89606.log 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157629.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90138.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136074.log 2023-11-01T03:53:52.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158301.log 2023-11-01T03:53:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.89606.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157629.log.gz 2023-11-01T03:53:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.136074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91096.log 2023-11-01T03:53:52.372 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89606.log.gz 2023-11-01T03:53:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158301.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.91615.log.gz 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91096.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158301.log.gz 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91655.log 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92412.log 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91096.log.gz 2023-11-01T03:53:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91655.log: 95.5% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90499.log 2023-11-01T03:53:52.374 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158551.log 2023-11-01T03:53:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92412.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.136074.log.gz 2023-11-01T03:53:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90078.log 2023-11-01T03:53:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158049.log 2023-11-01T03:53:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158551.log: /var/log/ceph/ceph-client.admin.90078.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158551.log.gz 2023-11-01T03:53:52.375 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158469.log 2023-11-01T03:53:52.375 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90078.log.gz 2023-11-01T03:53:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90499.log: /var/log/ceph/ceph-client.admin.158049.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90499.log.gz 87.1% -- replaced with /var/log/ceph/ceph-client.admin.158049.log.gz 2023-11-01T03:53:52.375 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136073.log 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120147.log 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158469.log: /var/log/ceph/ceph-client.admin.136073.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158469.log.gz 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92412.log.gz 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91705.log 2023-11-01T03:53:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107945.log 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91705.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.136073.log.gz 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.91655.log.gz 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91707.log 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91197.log 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0%/var/log/ceph/ceph-client.admin.107945.log: -- replaced with /var/log/ceph/ceph-client.admin.120147.log.gz 2023-11-01T03:53:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90491.log 2023-11-01T03:53:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91197.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91197.log.gz 2023-11-01T03:53:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90503.log 2023-11-01T03:53:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90491.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90491.log.gz 2023-11-01T03:53:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91829.log 2023-11-01T03:53:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90503.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.107945.log.gz 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90839.log 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0%/var/log/ceph/ceph-client.admin.91829.log: -- replaced with /var/log/ceph/ceph-client.admin.90503.log.gz 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90839.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.91707.log.gz 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90839.log.gz 2023-11-01T03:53:52.379 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.90500.log 2023-11-01T03:53:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91690.log 2023-11-01T03:53:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90500.log.gz 2023-11-01T03:53:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91667.log 2023-11-01T03:53:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91690.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.91690.log.gz 2023-11-01T03:53:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90322.log 2023-11-01T03:53:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91667.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.92286.log.gz 2023-11-01T03:53:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92295.log 2023-11-01T03:53:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90322.log.gz 2023-11-01T03:53:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91895.log 2023-11-01T03:53:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92295.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.92295.log.gz 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91146.log 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91895.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.91667.log.gz 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86110.log 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91146.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91146.log.gz 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125655.log 2023-11-01T03:53:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86110.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.86110.log.gz 2023-11-01T03:53:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91747.log 2023-11-01T03:53:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125655.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.125655.log.gz 2023-11-01T03:53:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-01T03:53:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91747.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.91640.log.gz 2023-11-01T03:53:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120146.log 2023-11-01T03:53:52.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91780.log 2023-11-01T03:53:52.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120146.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.120146.log.gz 2023-11-01T03:53:52.404 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.91705.log.gz 2023-11-01T03:53:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115386.log 2023-11-01T03:53:52.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91780.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.91780.log.gz 2023-11-01T03:53:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92197.log 2023-11-01T03:53:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115386.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.115386.log.gz 2023-11-01T03:53:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158217.log 2023-11-01T03:53:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92197.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.92197.log.gz 2023-11-01T03:53:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91330.log 2023-11-01T03:53:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158217.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158217.log.gz 2023-11-01T03:53:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92074.log 2023-11-01T03:53:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91330.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91330.log.gz 2023-11-01T03:53:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-01T03:53:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92074.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.91829.log.gz 2023-11-01T03:53:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158133.log 2023-11-01T03:53:52.452 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.92074.log.gz 2023-11-01T03:53:52.461 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158091.log 2023-11-01T03:53:52.462 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158133.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158133.log.gz 2023-11-01T03:53:52.475 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92239.log 2023-11-01T03:53:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.158091.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158091.log.gz 2023-11-01T03:53:52.477 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125656.log 2023-11-01T03:53:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92239.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92239.log.gz 2023-11-01T03:53:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157881.log 2023-11-01T03:53:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.125656.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125656.log.gz 2023-11-01T03:53:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-01T03:53:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157881.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157881.log.gz 2023-11-01T03:53:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90504.log 2023-11-01T03:53:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-01T03:53:52.500 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6%/var/log/ceph/ceph-client.admin.90504.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90504.log.gz 2023-11-01T03:53:52.501 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-01T03:53:52.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157923.log 2023-11-01T03:53:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157797.log 2023-11-01T03:53:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157923.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157923.log.gz 2023-11-01T03:53:52.528 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90830.log 2023-11-01T03:53:52.529 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.157797.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157797.log.gz 2023-11-01T03:53:52.529 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86453.log 2023-11-01T03:53:52.530 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90830.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90830.log.gz 2023-11-01T03:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115388.log 2023-11-01T03:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86453.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86453.log.gz 2023-11-01T03:53:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90825.log 2023-11-01T03:53:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.115388.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.115388.log.gz 2023-11-01T03:53:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92007.log 2023-11-01T03:53:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90825.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107946.log 2023-11-01T03:53:52.569 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90825.log.gz 2023-11-01T03:53:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92007.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.92007.log.gz 2023-11-01T03:53:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120148.log 2023-11-01T03:53:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.107946.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107946.log.gz 2023-11-01T03:53:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91288.log 2023-11-01T03:53:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.120148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90833.log 2023-11-01T03:53:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91288.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.120148.log.gz 2023-11-01T03:53:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92023.log 2023-11-01T03:53:52.624 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90833.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91288.log.gz 2023-11-01T03:53:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90228.log 2023-11-01T03:53:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92023.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90833.log.gz 2023-11-01T03:53:52.638 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92136.log 2023-11-01T03:53:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90228.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92023.log.gz 2023-11-01T03:53:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90826.log 2023-11-01T03:53:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92136.log: -- replaced with /var/log/ceph/ceph-client.admin.90228.log.gz 2023-11-01T03:53:52.662 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91964.log 2023-11-01T03:53:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.90826.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90826.log.gz 2023-11-01T03:53:52.667 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.92136.log.gz 2023-11-01T03:53:52.671 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92257.log 2023-11-01T03:53:52.681 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.91964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92329.log 2023-11-01T03:53:52.690 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92257.log: 92.9% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91964.log.gz 2023-11-01T03:53:52.699 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-01T03:53:52.700 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92329.log: -- replaced with /var/log/ceph/ceph-client.admin.92257.log.gz 2023-11-01T03:53:52.700 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92329.log.gz 2023-11-01T03:53:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-01T03:53:52.810 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:52.808+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:52.923 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.91895.log.gz 2023-11-01T03:53:53.752 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.91747.log.gz 2023-11-01T03:53:53.823 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:53.822+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:53.943 INFO:teuthology.orchestra.run.smithi153.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-01T03:53:54.255 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-01T03:53:54.828 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:54.827+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:55.510 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-01T03:53:55.812 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:55.811+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:55.831 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2023-11-01T03:53:55.831 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-01T03:53:56.098 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-01T03:53:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/ceph-osd.6.log: file size changed while zipping 2023-11-01T03:53:56.175 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-01T03:53:56.411 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-01T03:53:56.441 INFO:teuthology.orchestra.run.smithi005.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-01T03:53:56.532 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-01T03:53:56.747 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-01T03:53:56.749 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-11-01T03:53:56.749 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m4.469s 2023-11-01T03:53:56.750 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m16.837s 2023-11-01T03:53:56.750 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.518s 2023-11-01T03:53:56.821 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:56.820+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:57.264 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-01T03:53:57.266 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-11-01T03:53:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m4.986s 2023-11-01T03:53:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m23.780s 2023-11-01T03:53:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.830s 2023-11-01T03:53:57.267 INFO:tasks.ceph:Archiving logs... 2023-11-01T03:53:57.267 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi005/log 2023-11-01T03:53:57.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-01T03:53:57.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-01T03:53:57.852 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:57.841+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:58.855 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:58.838+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:53:59.803 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:53:59.800+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:00.253 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi153/log 2023-11-01T03:54:00.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-01T03:54:00.821 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:00.795+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:01.805 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:01.791+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:02.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-11-01T03:54:02.640 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-01T03:54:02.641 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-01T03:54:02.651 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-01T03:54:02.652 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-01T03:54:02.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-01T03:54:02.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-01T03:54:02.741 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-01T03:54:02.753 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-01T03:54:02.753 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T03:54:02.756 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-01T03:54:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2023-11-01T03:54:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2023-11-01T03:54:02.775 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T03:54:02.775 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-11-01T03:54:02.775 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +94us[ +94us] +/- 86ms 2023-11-01T03:54:02.776 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 +58us[ +55us] +/- 54ms 2023-11-01T03:54:02.776 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -188us[ -188us] +/- 64ms 2023-11-01T03:54:02.776 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:54:02.777 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-01T03:54:02.777 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-11-01T03:54:02.778 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +108us[ +106us] +/- 86ms 2023-11-01T03:54:02.778 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 +75us[ +74us] +/- 54ms 2023-11-01T03:54:02.778 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -165us[ -165us] +/- 64ms 2023-11-01T03:54:02.779 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-01T03:54:02.780 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-01T03:54:02.790 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-01T03:54:02.790 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-01T03:54:02.815 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-01T03:54:02.842 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:02.841+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:02.925 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-01T03:54:03.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T03:54:03.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:54:03.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-01T03:54:03.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:54:03.087 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-01T03:54:03.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-01T03:54:03.132 INFO:teuthology.task.internal:Duration was 3161.989944 seconds 2023-11-01T03:54:03.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-01T03:54:03.198 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-01T03:54:03.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-01T03:54:03.202 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-01T03:54:03.245 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T03:54:03.252 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-01T03:54:03.563 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-01T03:54:03.564 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-11-01T03:54:03.564 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-01T03:54:03.585 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-11-01T03:54:03.585 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-01T03:54:03.625 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-01T03:54:03.626 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-01T03:54:03.629 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-01T03:54:03.693 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-01T03:54:03.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-01T03:54:03.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-01T03:54:03.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-01T03:54:03.841 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-01T03:54:03.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-01T03:54:03.842 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:03.835+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:03.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-01T03:54:03.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-01T03:54:03.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-01T03:54:03.915 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-01T03:54:03.941 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-11-01T03:54:03.964 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-11-01T03:54:03.996 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-01T03:54:04.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:54:04.015 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-01T03:54:04.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:54:04.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-01T03:54:04.062 INFO:teuthology.task.internal:Transferring archived files... 2023-11-01T03:54:04.063 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi005 2023-11-01T03:54:04.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-01T03:54:04.103 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457/remote/smithi153 2023-11-01T03:54:04.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-01T03:54:04.139 INFO:teuthology.task.internal:Removing archive directory... 2023-11-01T03:54:04.140 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-01T03:54:04.143 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-01T03:54:04.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-01T03:54:04.199 INFO:teuthology.task.internal:Not uploading archives. 2023-11-01T03:54:04.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-01T03:54:04.235 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-01T03:54:04.236 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-01T03:54:04.238 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-01T03:54:04.251 INFO:teuthology.orchestra.run.smithi005.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 1 03:54 /home/ubuntu/cephtest 2023-11-01T03:54:04.251 INFO:teuthology.orchestra.run.smithi005.stdout: 655651 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 1 03:17 /home/ubuntu/cephtest/ceph.data 2023-11-01T03:54:04.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-01T03:54:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-01T03:54:04.253 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-01T03:54:04.254 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-01T03:54:04.266 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-01T03:54:04.302 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-11-01T03:54:04.303 INFO:teuthology.nuke:Checking targets against current locks 2023-11-01T03:54:04.306 INFO:teuthology.orchestra.run.smithi153.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 1 03:54 /home/ubuntu/cephtest 2023-11-01T03:54:04.307 INFO:teuthology.orchestra.run.smithi153.stdout: 393592 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 1 03:17 /home/ubuntu/cephtest/ceph.data 2023-11-01T03:54:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-01T03:54:04.329 DEBUG:teuthology.nuke:shortname: smithi005 2023-11-01T03:54:04.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-01T03:54:04.352 DEBUG:teuthology.nuke:shortname: smithi153 2023-11-01T03:54:04.352 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-01T03:54:04.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:52:27.195610', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEny+pvqlar+v530FdjsCfFT6WNVxnjZiEVDNl9tHCurGg35izLFzLw88y+c+P3NZYCEgtxJxtZeOnQVxRzVlKI='} 2023-11-01T03:54:04.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:52:27.193639', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSe1wvYgaRTWfJC1wmfL/tBooUp9AYWKvs7s/AVlyEmGvFKrKtBLRkOlu6DZgxX95h8uMJ4T0yKOE+i2J8t/P8='} 2023-11-01T03:54:04.404 INFO:teuthology.orchestra.console.smithi005:Power off 2023-11-01T03:54:04.404 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-01T03:54:04.421 INFO:teuthology.orchestra.console.smithi153:Power off 2023-11-01T03:54:04.422 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-01T03:54:04.432 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-11-01T03:54:04.433 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:04.445 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-11-01T03:54:04.445 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:04.456 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-01T03:54:04.469 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-01T03:54:04.794 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:04.793+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:05.815 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:05.814+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:06.859 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:06.858+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:07.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2023-11-01T03:54:07.857 INFO:tasks.ceph.osd.7.smithi153.stderr:2023-11-01T03:54:07.855+0000 f259640 -1 osd.7 929 heartbeat_check: no reply from 172.21.15.153:6804 osd.6 since back 2023-11-01T03:47:35.032763+0000 front 2023-11-01T03:47:35.031275+0000 (oldest deadline 2023-11-01T03:49:06.533937+0000) 2023-11-01T03:54:08.458 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:08.470 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:08.567 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-01T03:54:08.579 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-01T03:54:12.573 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:12.581 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:12.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2023-11-01T03:54:12.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-01T03:54:12.683 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-01T03:54:12.690 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-01T03:54:12.790 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-11-01T03:54:16.686 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-01T03:54:16.796 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-01T03:54:16.897 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-11-01T03:54:17.001 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 3161.9899435043335 failure_reason: saw valgrind issues flavor: default owner: scheduled_benhanokh@teuthology status: fail success: false 2023-11-01T03:54:17.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-01T03:54:17.064 INFO:teuthology.run:FAIL